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recently wrote a 
piece for the 
2016 Open 
Source Yearbook 
{1]. My piece was 
called “5 Initiatives 
that pushed the 
free software envelope in Europe in 
2016” (no, there was no subtitle like 
“Number 3 will make you cry!”). The 
piece looked at legislation and policies 
adopted in the public sector in Germany, 
Brussels (for the whole of the EU), the 
Netherlands, Russia, and Bulgaria. 

Being vain, I tweeted about it when it 
came out. Most people just liked the 
tweet or re-tweeted it. But one of my fol- 
lowers replied with “Hey! What about 
Spain?” He and I both live in Spain. At 
one point, Spain, or at least parts of it, 
was at the forefront of the adoption of 
Free Software in public administration 
[2]. So why didn’t Spain make the grade? 

First, there was the limitation that it 
was a yearbook about 2016. During the 
last year, Spain made no significant con- 
tribution to the job of advancing Free 
Software in the public sector. Sure, the 
Spanish administration has Linux run- 
ning on servers somewhere, but so does 
everybody else. Those machines were set 
up before 2016, or so deep down in the 
bowels of public institutions, that there is 
no perceivable effect on the outside 
world. 

What’s worse though is that, looking 
back, it turns out Spain has not made 
any advancement that pushes the “free 


INFO 


[1] 2016 Open Source Yearbook. 
https:/opensource.com/yearbook/ 
2016 

[2] Linex makes headlines: https:/ 
www.washingtonpost.com/ 
archive/politics/2002/11/03/ 
europes-microsoft-alternative/ 
26d7ad8b-1773-4079- ac75-b1d- 
3ca32e85d/ 


Dear Ubuntu User Reader, 


software envelope” in many, many years. 
Although there is not a single cause for 
this, a lot can be attributed to the 2008 
crisis that still cripples any kind of social 
and technological advancement here. Mi- 
grating to any kind of unfamiliar technol- 
ogy, including Free Software, is expen- 
sive short term. Only long term does so- 
ciety start to reap the benefits. 

But what is more damaging is the 
mindset of politicians. Back in the good 
old hey-look-we'’ re-in-the-Washington- 
Post days, each time a new regional dis- 
tribution was born, politicians would ap- 
pear smiling in the papers and on TV, 
holding up shiny CDs, as if they them- 
selves had compiled the kernel and con- 
figured the init files. 

Soon every megalomaniac, narcissistic 
regional Napoleon-wannabe wanted a 
piece of the sweet Free Software cake. 
This particular brand of envelope-push- 
ing usually started in the education de- 
partment. Because, you know, if you 
mess up a generation of kids with an un- 
tested policy, who cares? God knows, I 
am not against using Free Software in ed- 
ucation by any stretch of the mind, but I 
witnessed first hand how teachers were 
thrown in the deep end with no training, 
no support, and old and buggy materials. 
They were set up to fail from the begin- 
ning. 

Meanwhile, none of the smiling politi- 
cians bowed to using Free Software 
themselves. Instead they hung on to their 
Blackberries and MacBooks... and de- 
manded upgrades every year. 

It is true that something in the interest 
of the people (more Free Software in 
public administrations) aligned with the 
interest of the politicians in charge (an 
excuse for op eds and headlines) for a 
short while, but it didn’t take long for 
both to diverge and officeholders moved 
onto the next thing that would give them 
electoral brownie points. 

Because, here’s the thing, to success- 
fully introduce Free Software in the pub- 
lic sector, what the people in charge po- 
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tentially stand to 

gain or not should not be con- 

sidered. Free Software should be used at 
all levels of government because it is 
more sustainable and cheaper in the long 
run for society. In respect to official stan- 
dards, it is more inclusive for the people. 
It is safer for public data. And it respects 
the citizens’ privacy and freedom more 
than any other proprietary alternative 
can. That it could help a politician rise in 
the popularity polls is a non-factor. 

Of course, not seeking personal gain 
from an elected public post, nor pushing 
an agenda that benefits only your clique 
or the people who share your same ide- 
ology, but rather selflessly putting long- 
term social benefits before everything 
else should be the norm not the excep- 
tion. But then jobs in the public adminis- 
tration would be gray, hard, and thank- 
less. And this is fine. It’s like collecting 
trash or cleaning sewers: Someone has to 
do it. 

Unfortunately, we have politicians 
with personal ambitions, who see them- 
selves as stars, inflated egos and all - 
people who want to increase their for- 
tunes and influence. Even worse: we 
have voters who think that is kind of 
okay, the reasoning being why else 
would you to run for office? 

Until that mindset of “what do I stand 
to gain from this?” changes in elected 
public officials, there is no way Free Soft- 
ware can truly grow in the public sector, 
in Spain or, in fact, anywhere else. 


av 


Paul C. Brown, 


Editor in Chief 
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Discover the latest versions of the most 
popular Ubuntu-compatible distros, 
Linux Mint 18.1- Serena, and Neon 


e Guided kernel installation 
e Improved desktop features 


Essentials: Ubuntu’s repositories come with literally tens of 
thousands of packages. With so many apps to choose from, 
sometimes you may not know what to look for when searching for a 
tool for a specific task. In this issue we discover utilities that can be 
life-savers 


The moreutils Toolbox 


The moreutils package expands the standard tools for the 
shell with useful and sometimes exotic tools, 


Nine Easy Security Tools 


Ubuntu comes with a complete toolset of security utilities 
that make the process of securing your box much less 
painful. 
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KNow How ŽŻ DESKTOP 


Put Firefox on a Diet Linux Macro Photography 

Firefox tends to get sluggish pretty quickly when it is used In macro photography, multiple images are merged together 

intensively. There are some settings and add-ons available in order to generate a single picture. Under Linux, you have 

that can help it pick up speed again. plenty of tools which let you merge images for fabulous 
results. 


5 OSes on one USB stick é : Unity 8 - Desktop of the Future 


Ubuntu has turned the desktop inside out with Unity 8. 
However, Unity 8's new concepts do not always impress in 
-Mu their current state. 
you pack as many operating 

ns as you Want on one LXOt- Lean and Mean 

USB stick. LXQt is a lightweight desktop environment based on Ot 5. 
The similarities to LXDE are no accident. 


Ublock Origin Ad Blocker 
There is hardly a website out there that doesn't have 


advertisements and trackers. Some sites are practically 1) Partkeepr Inventory Manager 

flooded with them. Ad blockers like uBlock Origin can be j Staying on top of stock inventory 

used as effective countermeasures. i j i levels will allow you to plan for 
ae 5 capacity and profit. PartKeepr will 

Inotify Filesystem Monitor f : help you out 

Keeping an eye on possible changes to the filesystem can 


prove very beneficial. It can also help you to automate many 
processes. 


lh Online LaTeX Editors 


You can edit your LaTeX documents with online editors 
that run across platforms and are device independent. 

Documents get saved online, thus giving you and other 
members of a work group easy access from anywhere. 


Turbo-Charge with Watt0S 

The latest offering from PlanetWatt, this lightweight 
distribution is specifically geared towards energy efficiency, 
giving older machines a new lease on life 


If you are new to Ubuntu, these tutorials will help you get star 


84 Installing Ubuntu 16.10 90 Package Management 
We help you get started by walking you Ubuntu’s Software Center lets you install just 
through the process of upgrading or about anything, Come to grips with the app 
installing the latest Ubuntu release with that will open up a universe of free software. 
step-by-step instructions. 93 Multimedia 
88 Network and Updates You can configure your Ubuntu system 
Learn how to use Ubuntu's to support movies, music, and Internet 
NetworkManager to access your WiFi and telephony. Learn all about some of oura 
download updates. favorite multimedia apps. 


WWW.UBUNTU-USER.COM » UBUNTU USER 


o_o) DVD vux Mint 18.1 + Neon User LTS 0 


Linux Mint 18.1 + Neon User LTS 


ON THE DVD 


= = This month, on our double-sided disk we have the latest version of the most 
SB © @ =F 3 popular Ubuntu derivative, Linux Mint, and the up-and-coming, KDE-backed 
eee E Oar neon. 

On side A, you'll find the 64-bit version of Linux Mint, code named Serena, 
— = E a complete with the Cinnamon desktop and all the software available in the 
Ubuntu repositories. 
Side B comes with the 64-bit version of neon User LTS, an Ubuntu-based distro 
decked out with a bleeding-edge KDE Plasma desktop and apps. 


Desktop Window  shonans Starupand search 
Beraver Management Sandon 


Linux Mint 18.1 
Cinnamon 3.2 
Improved notifications 
Desktop background animations 
Autorotation on computers with accelerometers 
Guided kernel selection 
Neon User LTS 
KDE Plasma 5.8 
Sleek Plasma Desktop 
Kontact life organizer (email, calendar, notes...) 
KDE IM for Skype, Facebook Chat, Google Talk, etc. 
Direct access to latest versions of apps 


Douste-SıneD DVD 


This DVD is a double-sided Live disc. 
You can try out the operating systems 
on the disc without installing anything 
on your computer. You can later install 
Mint or Neon from the Live desktop. 
This DVD has a label on side A of the 
disc, so if you want to run Linux Mint, 
the side with the label should be fac- 
ing up in the tray. If you want to use 


PHP Snippets 


ZU4 = 5:53PM = 


ADDITIONAL RESOURCES Neon, you should insert the DVD in 
[1] Linux Mint: http:/www.linuxmint.com/ the tray with the label side facing 
[2] Neon: https:/neon.kde.org/ down. 
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The Ubuntu toolbox is jam-packed with interesting stuff. So much so, it is sometimes easy to miss 


what you really need. In this issue, we'll try and solve that. 


Tools you should know about 


ESSENTIALS 


BY PAUL C. BROWN 


buntu’s repositories come with 

literally tens of thousands of 

packages. With so many apps to 

choose from, sometimes you 
may not know what to look for when 
searching for a tool for a specific task. 
Other times, and if you're like me, you'll 
just get distracted and end up installing 
something that has nothing to do with 
what you were originally looking for, 
just so you can play with it. 

To address this problem, we have 
compiled in this issue a set of articles 
that cover tools to deal with software 
and system administration, distribution 
deployment, command-line scripting, 
and security. 

Take for example, our article on apt- 
fast. Apt-fast is the answer to slow and 
scatty Internet connections. Apt-fast al- 


lows you to identify the fastest mirror 
servers - usually those geographically 
nearer to you - and use them in parallel 
to download chunks from whichever is 
faster at any given moment. 

In our article on Etcher, you’ll learn 
how to create bootable USB drives with 
live and installable distributions in a 
snap. Three steps and a few minutes is 
all you'll need to get your USB ready. 

Getting down and dirty in the system, 
we look into all the Linux tools that will 
help you identify filesystems. Knowing 
what filesystem you’re dealing with and 
understanding some of their basic prop- 
erties will help you mount it, interact 
with it, and rescue your data if things go 
south. 

And if you feel the shell doesn’t come 
with enough tools to manage your sys- 


tem... well, you’d be wrong. But, just in 
case, the moreutils package gives you 
even more. This set of 15 terminal apps 
give you extra power in your command 
pipelines and scripts. 

Finally, we take a look at security and 
privacy protection from the point of view 
of the end user. Using half a dozen user- 
friendly applications, you will be able to 
audit your system and network, create 
sandboxes in which you can run inse- 
cure applications, use encrypted messag- 
ing, protect files and directories against 
tampering, set up firewalls to keep in- 
truders out, clean up your hard disk, and 
keep your passwords and emails safe. 

So, if you're feeling a bit at sea, don’t 
worry: we've got you covered; just check 
out all the things you soon won’t be able 
to live without. e 


Li Feng. Car sson, 128RF.com 
| 
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Apt-fast speeds up software installation under Debian, Ubuntu, and all its derivatives. 


Using apt-fast to accelerate installation of Debian packages 


SPEED UP! 


BY FERDINAND THOMMES 
he abbreviation Apt stands for dpkg, but only with restrictions. More- 
Advanced Packaging Tool. This over, Apt is definitely more clever 
is a console front end for Debi- when it comes to installation. This 
an’s package manager backend utility keeps an eye on all of the de- 
dpkg (“Debian Package”). Together pendencies, and it pulls packages from 
with the package management data- the Debian archive via the package 


base, Apt controls the heart of Debian. sources. Alternatives to Apt include 
It is possible to install a package using Aptitude and apt-get, which is gaining 


the reputation for being old fashioned. 
This is because Apt uses shorter com- 
mands to reproduce the functions of 
apt-get and apt-cache. In addition, Apt 
output comes in colors and has a prog- 
ress bar. 


Configuring apt=fast 
Stow Mirrors ilu E is cert ao ea 
No matter which front end you use, apteget 
insufficient speeds when you are ares 
downloading packages from the server she 


designated in the source list can be 
bothersome. Users who use Debian 
“Testing,” “Unstable,” and other roll- 
ing-release distributions are more fa- 
miliar than they would actually like to 
be with downloads that consist of sev- 
eral hundred megabytes. The shell 
wrapper apt-fast [1] intends to allevi- Figure 1: When installing apt-fast from the Ubuntu PPA, one of your configuration tasks will be to 
ate long download times, and it can be configure your package manager. 

used with Apt, apt-get, and also Apti- 
tude. 

Apt-fast promises to seriously re- 
duce download times for packages by 
switching over to a download manager 
that can handle parallel downloads 
with numerous connections per pack- 
age. Of course, this approach only 
makes sense when your Internet con- 
nection is faster than the mirror you 
are using. You will need to try this out 
for yourself with the pertinent server. I 
tested a relatively large LibreOffice 
download on a 120Mbps connection to 
find out how much time both Apt and 
apt-fast need on a freshly installed 
system. 


LISTING 1: INSTALLING APT-FAST 


Figure 2: It is easy to install apt-fast from GitHub using the Quickinstall script. 
$ sudo add-apt-repository ppa:saiarcot695/ 
myppa 


$ sudo apt-get update 


INSTALLATION 

Apt-fast has been under development 
since 2008, and it has been actively 
LISTING 2: MANUAL INSTALLATION distributed under Ubuntu, thanks to 
the Personal Package Archive (PPA). 
Accordingly, installation goes quickly 
(Listing 1). You should work on an ini- 
tial configuration during installation 


$ sudo apt-get -y install apt-fast 


$ git clone git://github.com/{1ik 
apt-fast.git 


$ sudo cp apt-fast/apt-fast /usr/ 


$ sudo chmod +x /usr/sbin/apt-fast 


$ sudo cp apt-fast/apt-fast.conf /etc 

$ sudo chown root:root /etc/apt-fast..conf LISTING 3: QUICKINSTALL INSTALLATION 

$ sudo chown root:root /usr/sbin/apt-fast 

$ sudo cp apt-fast/apt-fast.comp /etc/bash. 01 $ sudo /bin/bash -c ,$(curl -sL https://git.io/vokNn)* 

completion.d/apt-fast 02 $ wget -0- http://neuro.debian.net/lists/yakkety.us-ca.full | sudo tee /etc/apt/sources. 
$ sudo chown root:root /etc/bash_ list.d/neurodebian.sources.list 

completion.d/apt-fast 03 $ sudo apt-key adv --recv-keys keyserver hkp://pgp.mit.edu:80 OxA5D32F012649A5A9 

$ . /etc/bash_completion 04 $ sudo apt-get update 

$ sudo apt install aria2 05 $ sudo apt-get install netselect-apt 
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APT-FAST 


Figure 3: Netselect-apt selects the fastest servers in your area. 


nano 26.3 FL 


reteJapt.fast.cont 


nodir ted 


Figure 4: The control file /etc/apt-fast.conf contains numerous useful examples for configuring 
apt-fast. 
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(Figure 1). You will then need to make 
manual adjustments in order to 
achieve optimal speed, but more about 
this later. 

You can also pull the source code 
from GitHub and do a manual installa- 
tion as shown in Listing 2. The most 
recent modification dates from about 
three months ago. In other words, the 
developers are still actively working 
on the script. Even so, it is a safe bet 
that no changes are planned for basic 
functions. 

You can also install an up-to-date 
version of the program with QuickIn- 
stall. Use the command from the first 
line of Listing 3 in order to call the 
QuickInstall script. This command 


transfers the script, makes it execut- 
able, and also installs the apt-fast 
download manager aria2 onto the sys- 
tem (Figure 2). Since you want to 
make apt-fast available for the fastest 
mirror in your environment, you 
should also install the netselect-apt 
package (lines 3 to 6). 


LOCATING FAST SERVERS 
Use the command: 


sudo netselect-apt -t 5 


to find the five fastest servers in your 
environment (Figure 3), and add them 
to the configuration file. If you come 
up with other servers during testing, 
then you should use these. Copy the 
modified configuration file named apt- 
fast.conf to /etc/ and assign appropri- 
ate access rights to the file using: 


udo chown root:root /et 


If you want to always use apt-fast, it is 
a good idea to set up an alias in /etc/ 
bash.bashrc. You can do this with the 
following command: 


$ sudo „alias apt 


>> /etc/bash.bashre 


Now you can use apt-fast, for exam- 
ple, by entering apt install < Pack- 
age > or apt dist-upgrade. Depending 
on your preferences, you could also do 
something like convert the configura- 
tion file from apt-get to the newer Apt, 
thus adding a feature such as a prog- 
ress indicator. 


EDITING APT-FAST.CONF 

This is done by replacing apt-get with 
the editor of your choice in the apt- 
fast.conf file, which you copied previ- 
ously. You should go to the #_APTMGR 
line and insert /usr/bin/apt or, if you 
prefer, also /usr/bin/aptitude. In order 
to activate this line, you should re- 
move the hash sign # at the beginning 
of the line before saving. The com- 
mentary in /etc/apt-fast.conf (shown 
in Figure 4) describes how to ex- 
change the mirror server. 

Now you can use apt-fast with the 
fastest Debian and Ubuntu servers in 
your area and download packages in 
parallel with multiple connections. 
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The syntax is identical to that of apt- 
get, except you use apt-fast with in- 
stall, remove, upgrade, and dist-up- 
grade, and so on. Or you can use the 
alias that you defined before. 


PERFORMANCE 

It is difficult to predict whether it pays 
to use apt-fast since I don’t know the 
circumstances you are dealing with. I 
performed my tests with an optimized 
apt-fast.conf, a 120 Mbps connection, 
and installations of the LibreOffice 
package on a freshly installed system. 
During the course of downloading the 
package several times, download times 
were reduced by one fifth or even half. 
Downloads that take between 7 and 10 
seconds without apt-fast usually re- 
quire about 5 seconds when the utility 
is used on an identical system. 


CONCLUSION 

The speed of your available mirror and 
your download volumes will deter- 
mine whether it makes senses to go 
through the effort of installing and 
configuring apt-fast. 


What?! Archives 


come with my digital subscription? 


shop.linuxnewmedia.com 


That’s a lot of articles! 


Sign up for a digital subscription to get the latest issues 
of Ubuntu User, PLUS access to archive articles. 


You gain an additional advantage 
due to the installation of the download 
manager aria2. This is because it lets 
you increase the speed of all down- 
loads, even when apt-fast is not in- 
volved. This tool only comes with 
command-line control [2]. However, 
webui-aria2 [3] also has a graphical 
interface for the browser. 

A closer look at the apt-fast compo- 
nents did not reveal any negative side ef- 
fects that occurred when it was installed 
as the Ubuntu package manager. The 
one piece of criticism I would like to 
offer is that the developer should move 
the quick installation to /usr/local/bin/ 
since the dpkg package manager is the 
only thing that actually belongs in /usr/ 
bin/. Otherwise, it would be fair to say 
that if apt-fast is helpful to you, there is 
nothing that says you shouldn’t use it. e 


INFO 


[1] Apt-fast: https:/github.com/ilikenwfapt-fast 


[2] Aria2: https:/aria2.github.io/ 


[3] Webui-aria2: https:/github.com/ziahamza/webui-aria2 
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Etcher is an easy-to use graphical tool for making a bootable USB from an ISO file. 


Creating bootable USB Drives with Etcher 


SAFE RECORDING 


BY ERIK BARWALDT 


å Marcel Derweduwen, 123RF 


s a rule, distributions can be 

downloaded from the Internet 

as ISO files. If you are not 

using the file in a virtual ma- 
chine, you will have to put it ona 
bootable data storage device. Previ- 
ously, CD/DVD burners took on the 
task of putting an ISO image on a fresh 
medium. Nowadays, USB drives and 
SD cards have become the medium of 
choice. 

This change has occurred for a num- 
ber of reasons. For one thing, most 
handheld computers like note- 
books and compact ultra 
books no longer 
come with an opti- 
cal drive. With 
the introduc- 
tion of USB 
2.0 specifi- 
cations, 
the 


USB interface allows for enough speed 
to start an entire operating system 
within an acceptable amount of time. 
Currently, USB 3.0 lets high perfor- 
mance sticks achieve transfer rates of 
over 200MBps. These rates far surpass 
those for optical drives. 

Under Linux, there are several, well- 
established tools that can easily create 
a bootable USB drive. Even so, the old 
adage “the devil is in the details” is 
definitely applicable here. Many ISO 
files do not start by themselves from a 
USB. At the very least, you will have 
to carefully prepare the drive before 
loading the image. 


SYSTEMATIC 

ISO files are based on the ISO 9660 
filesystem standard [1] that was re- 
leased in 1986. This is a standard that 
was specially created for optical data 
storage devices. In order to start an 
operating system image from an opti- 
cal data storage device, the device has 
to have a boot sector according to the 
El Torito standard, which allows live 
operation without installing the sys- 
tem. However, ISO files with an El To- 
rito boot sector are not suitable for 
booting from a USB drive. 
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The ISO 9660 standard allows for 
the system area at the beginning of the 
filesystem to integrate multiple boot 
sectors in a single image. This makes 
it possible for a given volume boot re- 
cord (VBR) to start the operating sys- 
tem from a flash drive. SD cards can 
be used as an alternative. These cards 
are also suitable for use as VBR-en- 


Etcher - x 


SELECT IMAGE 


SELECT DRIVE 


FLASH IMAGE 


Op aaa Oe 


minux-1.0.1,iso @ idevisdb - 4.0 GB 


abled boot media. ISO images that in- 
tegrate different boot sectors are 
known as hybrid images. 

Another problem arises with the 
filesystems on memory sticks. Cur- 
rent devices insist on the use of a 
FAT32 filesystem. This means that 
ext3/4 and NTFS do not work for cre- 
ating bootable USB drives. Therefore, 
you don’t have to modify the filesys- 
tem on a newly purchased drive since 
practically all of them now come 
with FAT32 by default. Older memory 
sticks and first generation SD cards 
mostly come with FAT16, which is 
also suitable for creating a start me- 
dium. 


DD 

The command-line tool dd [2] is typi- 
cally used under Linux for sending ISO 
files to a USB drive. This is a reliable 
and stable tool. It requires input from 
the source (if) and the target (of). You 
will need to pay special attention 
when inputting the target drive. If the 
path or drive is not correct, then you 
may end up overwriting the local hard 
drive. 

Several graphical tools that are dis- 
tribution-specific like USB ImageWriter 
[3] under Linux Mint, ImageWriter [4] 
under openSUSE, or the ROSA Image- 
Writer [5] from ROSA Linux serve as 
front ends for dd. This simplifies the 
operation of this tool. 

Reformatting the drive is frequently 
omitted, or reformatting is launched 
by externally connected tools. How- 
ever, such tools exclusively write hy- 
brid images to a USB drive since they 
produce a copy of the ISO image byte 
by byte. For this, you will most proba- 
bly need a USB drive that has likewise 
been prepared with the suitable file- 
system. 

UNetbootin [6] is the only current 
tool that can also transfer non-hybrid 
images to a USB drive correctly. It is 
able to do this by making complex 


ÆTCHER 


Figure 1: Etcher reduces the number of operating elements to the absolute minimum in order to 


create the maximum simplicity of use. 


modifications to the image file. How- 
ever, the tool often fails when dealing 
with current ISO images without an 
entry for a VBR boot sector. 


ALTERNATIVE 

The Javascript program Etcher is one 
of the newcomers in the ISO transfer 
business. It was developed by Resin. 
io, an American company that was 
founded in 2013 and builds software 
for the Internet of Things. The cross- 
platform framework Electron serves as 
the basis for Etcher. Resin.io relies 
heavily on Linux and has developed 
Etcher in order to write images of op- 
erating systems to USB drives with 
maximum speed and efficiency so they 
can be used with appliances. As a con- 
sequence, you won’t find the interface 
for this software overloaded with op- 
tions. 

To install Etcher, first download the 
ZIP archive [7], which is just shy of 
70MB, to the suitable hardware archi- 
tecture for you computer. The archive 
contains a single executable file, 
which is named either Etcher-linux- 
x86.ApplImage or Etcher-linux-x64.Ap- 
plmage. Once decompressed, click to 
start the software. When started, the 
software will ask whether the in- 
staller should integrate the software 
in the system. Then comes the actual 
program window, which makes do 
without the customary operating ele- 
ments like menus and list views (Fig- 
ure 1). 

Three horizontally arranged icons 
are used in the creation of a bootable 
USB drive. To the far left under SE- 
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Etcher Sa 
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SELECT IMAGE SELECT DRIVE 


Minoca-pe-1375.zip @ Idevisdb - 4.0 GB 


SETCHER resin.io 


Figure 2: After the flash process starts, an indicator bar shows its progress. 


LECT IMAGE, you open a file manager 
by clicking on Change. Here you will 
select the image to be written. Etcher 
can handle ISO images, and it also rec- 
ognizes things like IMG image files for 
SD cards, as well as ZIP archives and 
archive tarballs. When an archive file 
is decompressed, it must meet all of 
the requirements of an ISO image to 
work. 

Specify the target drive using the 
middle option SELECT DRIVE. Nor- 
mally, the application will automati- 
cally recognize this drive, but you 
can change the target drive by click- 
ing on the Change button if it 
doesn’t. Check the desired drive in 
the corresponding dialog with a 
mouse click. Then close the selection 
by clicking on Continue. 

At the far right, the FLASH IMAGE 
is the last icon you need to know 
about. Underneath you will find the 
Flash! button. After authentication, 
you should use this button to write 
the image to the target drive. The 
software does not expect that you 
have unmounted the drive or manu- 
ally formatted it with the appropri- 
ate FAT filesystem. Instead, the soft- 
ware accomplishes the write process 
without the need for any further 
manual intervention. During the 
write process, the Flash! button 
turns into a progress indicator (Fig- 
ure 2). 

After the writing process has ended, 
the tool checks the data storage de- 
vice for consistency and then shows a 
dialog asking whether you would like 
to write the same image again or 
whether you would like to send it to 


another device (Figure 3). Lastly, 
Etcher automatically unmounts the 
target drive, meaning you can imme- 
diately take the USB drive out with- 
out running the risk of damaging the 
filesystem. 


OPTIONS 

Additionally, Etcher has a very simple 
settings window that you can call by 
clicking on the cog wheel icon at the 
top right of the home screen. Settings 
only includes three options, which you 
activate and deactivate by means of a 
check mark. By default, the tool acti- 
vates the auto-unmount function upon 
the conclusion of a successful burn. It 
also activates the write validation op- 
tion and the protocol function for er- 
rors. 

During testing, deactivating the 
functions had no effect on how fast 
the software ran. Therefore, I recom- 
mend that you leave the default set- 
ting alone for purposes of data integ- 
rity. The Back button at the top right 
of the window takes you from Settings 
back into the home screen. 


RESULTS 

Based on my practice tests, I find 
Etcher appealing but not entirely con- 
vincing. For example, I noticed one 
small defect that appeared when the 
software started under Mageia 5, 
ROSA Linux R8, and openSUSE Leap 
42.1. Each time an error message 
popped up informing me that user 
rights were missing. This kept happen- 
ing even though the FUSE libraries had 
been completely integrated into each 
system. However, the software started 
gracefully under Ubuntu 16.04 and 
Linux Mint 18; the pesky error mes- 
sage did not appear. 

The window that is superimposed 
on the home screen and indicates the 
possibility of integration in the menu 
system for the given desktop proved 
to be a dummy only. Moreover, 
Etcher was not able to create a 
bootable flash drive from non-hybrid 
images with only one El Torito boot 
sector. 

Even so, Etcher proved reliable in 
recognizing each mounted USB drive 
and its operating status without the 
need for additional manual work. The 
validation function for the write pro- 
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cess ensures a high level of data integ- © Need Help? 
rity. 


¥) Flash Complete! 


CONCLUSION 
Desktop-specific tools for sending OS 
images to USB drives often rely on ex- 
ternal formatting routines. They also 
often require that the user unmount the Use samo image Use new image 
prepared flash drive manually. These 
tools can therefore cause confusion in- 
stead of making the transfer easier. 
Etcher makes these steps obsolete. 


ödesos76 


All you have to do with this program BEI SHED Cine 

is to select the image and launch the Figure 3: If desired, the software can prepare multiple USB devices in succession. 

write process. The software will reli- 

ably take care of the rest. Moreover, INFO 

the software accepts both ISO files as 

a source, and also images in IMG and [1] ISO 9660: https:/en.wikipedia.org/wiki/ISO_9660 

archive form. [2] The dd tool: https:/www.gnu.org/software/coreutils/manual/html_node/ 
However, with hybrid images, Etcher dd-invocation.html 

also assumes that exotic distribution [3] USB ImageWriter: https:/launchpad.net/usb-imagewriter 


images with El Torito boot sectors are 
not suitable. Due to the fact that the 
project is under constant develop- 


[4] openSUSE ImageWriter: https:/en.opensuse.org/SDB:Live_USB_stick#Using_ 
SUSE_Studio_Image_Writer 


ment, it is entirely possible that exist- [5] ROSA ImageWriter: http://wiki.rosalab.com/en/index.php/ROSA_ImageWriter 
ing deficits, like the missing desktop [6] UNetbootin: https:/unetbootin.github.io 

integration, will soon be a thing of the [7] Etcher download: https:/etcher.io 
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Linux has some compact tools for quickly finding out the filesystem of a given storage medium. We 
show you how to use these effectively. 


Determining the filesystem for storage media 


BY FRANK HOFFMAN 


inux can handle a wide variety 
of filesystems. However, in 
order to achieve problem-free 
use of a data storage device, it 
is a good idea to at least know what 
type of filesystem is on the device. 
Attempts to restore data on storage 
medium that have an unknown file- 
system can be very difficult. Similar 
difficulties occur in situations in 
which you want to read a down- 
loaded image of a DVD or an un- 
known data storage device and 
therefore have to incorporate it in 
the system. This can also be the case 


UESSING GAMES 


for new media, like recently pur- 
chased memory cards. 

We take a closer look at the rele- 
vant out-of-the-box tools available 
for determining the correct type of 
filesystem. After that, we look at the 
partition and then the integration of 
the directory, which is made avail- 
able via the network and the storage 
medium, into the system. 

Mounting a filesystem is accom- 
plished by a user with administrative 
rights on the mount command. Usu- 
ally, this means as a root user. As part 
of the mount procedure. vou should 


UBUNTU USER + WWW.UBUNTU-USER.COM 


$ cat /proc/filesystems 
nodev sysfs 
nodev rootfs 
nodev ramfs 
nodev bdev 
nodev proc 
nodev cpuset 
nodev cgroup 
nodev tmpfs 
nodev devtmpfs 
nodev debugfs 
nodev tracefs 
nodev securityfs 
nodev sockfs 
nodev bpf 
nodev pipefs 
nodev devpts 
ext3 
ext2 
ext4 
squashfs 
nodev hugetlbfs 
vfat 
nodev ecryptfs 
fuseblk 
nodev fuse 
nodev fusectl 
nodev pstore 
nodev mqueue 
nodev autofs 
nodev binfmt_misc 
nodev cifs 
Figure 1: A standard kernel's integrated file- 


systems under Ubuntu. 


enter a mount point that tells the sys- 
tem where it should incorporate the 
filesystem in the local filesystem tree. 
If you do not enter a mount point, 
then the command pulls the prepared 
partitions or storage media into the 
filesystems table (/etc/fstab) in order 
to find a directory that should serve 
as the mounting point. 

There is a list of the filesystems 
that have already been incorporated 
in the /proc/mounts file. This file 


LISTING 1: MOUNTING A FEDORA DISK 
IMAGE 


# mount -v 
Fedora-Xfce-Live-x86_64-24-1.2.iso /tmp/ 
usb-platte/ 

mount: /dev/loop0 is write-protected, 
mounting read-only 

mount: /dev/loop0 mounted on /tmp/usb-drive. 
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Command (m for help): p 

Disk Fedora-Xfce-Live-x86_64-24-1.2.iso: 1,1 GiB, 1132462080 bytes, 2211840 sectors 
Units: sectors of 1 * 512 = 512 bytes 

Sector size (logical/physical): 512 bytes / 512 bytes 

I/O size (minimum/optimal): 512 bytes / 512 bytes 

Disklabel type: dos 

Disk identifier: 0x6d731e67 


Device 

Fedora-Xfce-Live-x86_64 
Fedora-Xfce-Live-x86_64-24-1. 
Fedora-Xfce-Live-x86_64-24-1.2. 


Boot Start End Sectors Size Id Type 

© 2211839 2211840 1,1G 0 Empty 
90084 100723 10649 5,2M ef EFI (FAT-12/16/32) 
100724 124067 23344 11,44 © Empty 


Command (m for help): Hf 


Disk: Fedora-Xfce-Live-x86_64-24-1.2.iso 
Size: 1,1 GiB, 1132462080 bytes, 2211840 sectors 
Label: dos, identifier: 6x6d731e67 


End 
2211839 
1 


11,44 


1019M 


100724 © Empty 


124067 
Free space 124928 2211839 2 


23344 
22 2086912 


Type J} [ Help } [ Write ] 


| [ Delete } | Quit J I 
Figure 2: Filesystems in a mounted ISO image, above in fdisk and below in cfdisk. 


mirrors the kernel’s information. 
The mounted filesystems table, /etc/ 
mtab, was previously responsible for 
this task. Today, this table usually is 
a symbolic link to /proc/mounts. 

The -t option in the mount com- 
mand specifies the interpretation 
that the operating system applies to 
the type of the filesystem it will in- 
corporate. Below, you can see an ex- 
ample of a call that mounts a parti- 
tion in the /opt/usb-drive/ directory. 
This is the first partition of the sec- 
ond hard drive, and it has been for- 
matted with ext3. 


# mount -t ext3 /dev/sdbl 2 
/opt/usb-drive 


The types of filesystem that your 
system supports depends on the type 
of kernel components statically inte- 
grated or what has been loaded as a 
kernel module. In order to determine 
the correct type of filesystem, you 
can take the following approaches: 
1.Try things out with mount until 
something works 
2.Have the operating system recog- 
nize what type of filesystem sits 
on the storage media 
3.Use a suitable tool for finding out by 
yourself what kind of filesystem it is. Listine 3: PROBING A FEDORA ISO 


IMAGE 


LisTING 2: USING BLKID 


# bikid -s TYPE Fedora~Xfce-Live-x86_64-24-1 
+2.1S0 

Fedora-Xfce-Live-x86_64-24-1.2.iso: 

TYPE="7 509660" 


# blkid -ps TYPE /dev/sdal 


/dev/sdal: TYPE="ext2” 
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# lsblk -f 


l-sda5_crypt 
fehmarn--vg-root 
fehmarn--vg-var 
fehmarn- -vg-swap_1 
fehmarn- -vg-tmp 
fehmarn- -vg-home 


FSTYPE 


ext2 


crypto_LUKS 
LVM2_member 


ext4 
ext4 
swap 
ext4 
ext4 


LABEL UUID 


7ca005b2-a7ff-4757-bfdf-81004d4072eF 


305a1a1b-797a-4634-9acd-49c1f530978b 

OzenSy-a9z1-Ko95-pLTk-OfsC-3b0x-wHmtXw 
3d7b7281-a946-4b54-a4f0-7eec81e237d0 / 
7b19cfab-53cf-4a09-9e48-380c94f5a95f 
6aedb5f7-4887 -47e6 - bbf6-530f7006167b 
39e70a02-2b3e-45ac - 940f -70d790b8ab7F 
d760e088 -b5d6 -4b76 - 9028 -89cd25540db2 


MOUNTPOINT 
/boot 


/var 
[SWAP] 
/tmp 
[home 


Figure 3: Isblk offers easy to understand output in a tree-like form on all of the block devices. 
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The first approach is frustrating and 
can take a long time. The second ap- 
proach is reliable and works well. The 
third approach is appropriate when 
you don’t want to bother with the first 
approach, and the second approach 
hasn’t worked for reasons you don’t 
know but would like to uncover. 


Auto-DETECT 

Automatic identification of the file- 
system type is accomplished in 
mount by calling the program either 
without the -t or explicitly with -t 
auto. mount will try to identify the 
filesystem with the help of the lib- 
blkid [1] library. If the filesystem is 
successfully identified, the program 
will mount the media without ac- 
knowledging this directly by using 
so-called silent mode. 

Otherwise, mount evaluates the 
entries in the /proc/filesystems file. 
Figure 1 shows the file as it appears 
on an Ubuntu system. The entries 
marked with the nodev keyword in- 
dicate that no corresponding filesys- 
tem is currently allocated to a block 
device [2]. 

In most cases, mounting works 
like this, at least for common filesys- 
tems. These would include ext2/3/4, 
VFAT, and MS-DOS. Btrfs, XFS, and 
ZFS, on the other hand, are more 
difficult candidates for mounting. 
They need additional modules and 
potentially also more software pack- 
ages. Once these needs are met, the 
corresponding versions of com- 
mands from fsck, mount, and mkfs 
also work with these systems. 

The -v option causes mount to pro- 
duce an additional status message 
once the process has been success- 
fully completed. Listing 1 demon- 


strates this for a Fedora image, 
which mount recognizes as a CD/ 
DVD (ISO 9660). 

If the automatic detection func- 
tion fails to identify the filesystem 
that is to be mounted, then you will 
be forced to switch over to the third 
approach described above and find 
out for yourself what type of filesys- 
tem you are dealing with. Fortu- 
nately, there are some on-board 
tools that work smoothly with this 
approach. 


FDISK 

You can use fdisk and its convenient 
ncurse version, cfdisk, to arrange 
the partitions on the storage medium 
including setting up new partitions, 
deleting old ones, and setting a 
bootable flag to make a partition 
boot-ready. Use 


fdisk /dev/sda -1 


in the terminal to output the first 
hard drive’s entire partition table. In 
a similar fashion, 


cfdisk /dev/sda 


puts the information you have 
searched for up on the screen for 
you to see. 

fdisk and cfdisk usually only dis- 
play the type of partition, meaning 
you only see filesystems that are po- 
tentially supported. This is common 
with Linux, Solaris, BSD, Mac OS X 
and Windows. We are a bit luckier 
with the mounted ISO image in Fig- 
ure 2, and we have learned some 
useful details. The second entry con- 
tains a FAT filesystem. 
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>! FEATURES IDENTIFYING FILESYSTEMS 


File System 


Label: 
dev/s¢  UUID: 
i “ Status: 
Partition 
Path: 
Name: 
Flags: 


i 
| 
| 
l 
| 
| 
| 
| 
| 
] 


0 operations pending 


Information about /dev/sda1 


fag /dev/sdat 
be 147.06 GiB 


File system: 


ext4 


$a4F2814-da32-4717-a33e-eb4c43ca5546 Size: 


Mounted on / 


/dev/sda1 


boot 


Used: 
Unused: 


9.53GiB_ (6%) 
137.53GiB (94%) 
147.06 GiB 


First sector: 2048 
Last sector: 308406271 
Total sectors: 308404224 


Figure 5: If necessary, GParted can deliver extensive details about the mounted filesystem. 


LISTING 5: USING FILE 


This makes mapping easier. The -f, 
long form --fs, option delivers the 
same information as: 


-0 NAME, FSTYPE, LABEL MOUNTPOINT 


In this way, you can see the details 
of how the individual storage media 
have been mounted. 

The second column of the output 
contains information about the file- 
system. Figure 3 shows sda1 (ext2), 
as well as sdaS (CryptoFS). Under- 
neath you can see an LVM2 with log- 
ical volumes that have been set up 
and formatted as ext4 or swap. All 
of the filesystems have already been 
mounted. 

Figure 4, on the other hand, shows 
an example with an ISO image that 
has been identified but not yet 
mounted. An ISO 9660 filesystem 
has already been allocated to the / 
dev/sr0 device. If needed, this can 
be mounted with the command: 


# mount -t 1s09660 /dev/sr0 /tmp/iso 


In order for this to work, the /tmp/ 
iso/ directory should already exist. If 


# file -s /dev/sda5 


/dev/sda5: LUKS encrypted file, ver 1 (aes, xts-plain64, shal] UUID: 305alalb-7974a-4634-9acd-49c 


1f530978b 


20 ISSUE32 


it doesn’t, then you should first 
quickly set it up with: 


mkdir /tmp/iso 


PARTED 

As with the graphical tools Kvpm [3] 
and GParted [4], parted proves to be 
information friendly. parted delivers 
detailed information about partitions 
with the -l (--list) option. Listing 4 
shows the excerpt from the last line 
of Figure 3. In the fifth column of 
the output, you will see the filesys- 
tem, which in this figure is ext4. 
GParted delivers similarly large 
amounts of information but much 
more elegantly and in graphical for- 
mat (Figure 5). 


FILE 

Occasionally, the file command also 
comes in handy. This command 
yields information about a given 
entry in a filesystem. By default, it 
ignores unusual entries like “special 
files.” However, file is able to read 
these entries with the help of the -s 
(--special-files) option. Listing 5 
shows the call for the fifth partition 
on the first hard drive. The call cor- 
rectly finds an encrypted filesystem 
(LUKS) on the drive. 


CONCLUSION 

Specialized tools such as blkid, lsblk, 
parted, and file deliver extensive 
amounts of information about a stor- 
age medium’s filesystem. Using these 
tools does not require much effort on 
your part. As a result, there should be 
nothing keeping you from cleanly 
mounting a data storage medium. e 


INFO 


[1] libblkid: https:/github.com/ 
karelzak/util-linux/tree/master/ 
libblkid 

[2] CentOS /proc/filesystems: https:/ 
www.centos.org/docs/5/html/5. 1/ 
Deployment_Guide/ 
s2-proc-filesystems.html 

[3] Kvpm: https./sourceforge.net/ 
projects/kvpm/ 

[4] GParted: http:/gparted. 
sourceforge.net/ 
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# Usblk -f 
NAME  FSTYPE LABEL UUID MOUNTPOINT 
sda 

sda1 ext4 7ca005b2-a7ff-4757-bfdf-81004d4072ef / 
—sda2 ext4 7b19cfab-53cf-4a09-9e48-380c94f5a95f /usr 
—sda3 ext4 39e70a02-2b3e-45ac-940f-70d790b8ab7f /home 
—sda4 
—sda5 swap 6aedb5f7-4887-47e6-bbf6-530f7006167b [SWAP] 
—sda6 ext4 d760e088-b5d6-4b76-9028-89cd25540db2 /var 
sro iso9660 Fedora-Xfce-Live-24-1-2 2016-06-14-16-58-14-00 
Figure 4: Underlying the filesystem that has been recognized by Isblk, there is also an ISO image that has not yet been mounted. 


BKR ISO image used in Figure 2. The 


The blkid (“Block ID”) tool reads the 
information to the filesystems, relying 
on the libblkid library previously men- 
tioned. Listing 2 shows the call for the 
first partition of the first hard drive. 
The -p option makes sure that the 
tool ignores the information from 
the drive cache and instead accesses 
the data storage device directly. 
Since the output from blkid is typi- 
cally very large, you should restrict 


TYPE option also contains the cor- 
rect parameters that the mount pro- 
gram can use for attaching the file- 
system to your directory tree. 

blkid possesses additional useful ca- 
pabilities. For example, it can check 
for the existence of particular filesys- 
tems and also display numerous pieces 
of detailed information. The option 
corresponding to this functionality is 
described on the program man page. 


LISTING 4: PARTED OUTPUT 


Model; Linux device-mapper (linear) (dm) 
Disk /dev/mapper/fehmarn--vg-home: 227GB 
Sector size (logical/physical): 5128/5128 
Partition Table: loop 

Disk Flags: 


it with the -s TYPE option for infor- 
mation about the filesystem. In List- 
ing 3, you can see the information 
that blkid has found digging into the 
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Number Start End Size File system 


LSBLK 
The /sblk command outputs a list of 
block devices in a tree-like form. 


Flags 


1 0,008 227GB 227GB ext4 
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REUTILS 


The moreutils package expands the standard tools for the shell with useful and sometimes exotic 
tools. 


moreutils completes the shell’s toolbox 


EXPANSIONS 


BY KARSTEN GUNTHER 
he shell lets you string together a tirely possible that you have never heard of 
myriad of discrete tools to solve any of them. But if you spend a lot of time 
complex tasks. Often the Coreutils on the command line, then it would be a 
utilities from the util-linux package good idea to keep these small programs 
are enough. There are, however, a number handy. 
of situations that still don’t have a standard The current version of moreutils includes 
solution in the form of a tool. 15 programs (see Table 1). Each program is 
Together with some friends, Joey Hess a nifty little tool that comes with a few op- 
has developed a set of programs grouped tions and is designed to accomplish a par- 
under the name moreutils [1] to fillsome of ticular task. The tools were developed 
these gaps. For the most part, these are along the lines of classic Unix tools, so they 
specialized tools. Consequently, it is en- work with a syntax that shares underlying 
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similarities and concepts. There is a man 
page for each program; unfortunately, 
these are not very informative. See the “In- 
stalling moreutils” box for installation in- 
formation. 


CHRONIC 

In some situations, such as those involv- 
ing scripts or cron jobs, the outputs of a 
program are irritating. chronic is helpful 
in resolving this problem. It expects the 
name of a program as its argument. 
chronic ignores the program’s STDERR 
(error channel) and STDOUT (output 
channel) channels until an error actually 
occurs. You could do the same by using 
the construct 


> ‘dev/null 281 


except that it would no longer be possible 
to preserve the output generated in the 
case of an error. The redirection to the null 
device simply would get rid of everything. 
Consequently, chronic is the better alterna- 
tive. 

Below is an example that uses chronic. 
Normally, this command line would create 
the desired EPUB file without generating 
any additional output. However, if an error 
does occur, you will get the entire output 
on the two channels, STDOUT and 
STDERR. 


$ chronic 22x -v -fepub *.adoc 


Two options control the behavior of 
chronic. The -e option, or STDERR trigger- 
ing, makes sure that the program does not 
evaluate the executed program’s return 
code. Instead it will decide whether errors 
have occurred on the basis of the output on 
STDERR. By default, a return code not 
equal to zero triggers an output. 

chronic outputs a somewhat more de- 
tailed output if you use -v. In particular, 
this includes the return code for the exe- 
cuted program. In the process, it decides 
between the output on STDERR and STD- 
OUT of the program that has been called. 


TABLE 1: CATEGORIES 


Category 
Start programs 


chronic, ifne, Ickdo, parallel, zrun 


IFNE 


The syntax for the ifne command is similar 
to that of chronic, and it also launches the 
program whose name is its first argument. 
However, it first evaluates the standard 
input in order to decide whether to actually 
start the program. Without any options, 
ifne will start the program only when the 
corresponding channel is not empty. 

Below is a typical example from the man 
page. The administrator receives an email 
here if the find command finds at least one 
core file. The message directly contains the 
paths for the located files. 


$ find . -name core | ifne mail 2 


-s "Core files found" root 


ifne has one option, -n, that reverses its be- 
havior. With this option, it will start the 
designated program only when the stan- 
dard input is empty. 


LCKDO 

When automated processes are running, 
there are many situations in which just one 
instance of a program is permitted to run. 
If a process takes longer to execute due to 
an unexpectedly large amount of data that 
needs to be processed, then conflicts can 
arise, and you can even lose data. If cron 
launches programs at intervals that are too 
short, it can lead to a never-ending loop. 
The first instance has not yet finished its 
task while the next one overwrites the in- 
complete database. 

In these situations, programmers will 
normally resort to lock files. Before the 
actual work begins, you should have the 
task set up a file. Often the file is empty, 
and typically you would set it up under / 
var/lock/. When the task finishes, it de- 
letes the file. If the file already exists 
when the task tries to start, then the 
software doesn’t even run. Sometimes 
the lock file also contains the ID for the 
process that set it up. 

This kind of lock mechanism is fairly un- 
complicated to implement, even in scripts. 
However the Ickdo option makes life even 


| Edit (text) files 


combine, isutf8, ts, vidir 


Tools for Pipes 


mispipe, pee, vipe, sponge 


Error Handling 


errno, ifdata, isutf8, mispipe 
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INSTALLING MOREUTILS 


You can find moreutils in the reposito- 
ries of Ubuntu, Debian, and their de- 
rivatives, however not in the most re- 
cent version 0.60. This version is avail- 
able for download on the project web- 
site [1]. There are many other distribu- 
tions, but not all, that also offer 
moreutils in their package source. If 
you are using a distribution that does 
not have this package, then you will 
need to compile the sources. 


Grab the source code with: 


git clone git://git.joeyh.name/moreutils 


LISTING 1: USING LCKDO 


$ lckdo [Option] Lock-File Program 


LISTING 2: LCKDO OUTPUT 


01 $ Ickdo yes.lock yes& 

02 $ Ickdo yes.lock yes 

03 Ickdo: lockfile ~yes.Jock" is already 
locked 

04 $ Ickdo /var/lock/yes.lock yes& 

05 1ckdo: unable to open ,/var/lock/yes. 


lock’: Permission denied 
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Figure 1: Loading compressed files in the editor usually yields garbage. 


LISTING 3: PARALLELL-MOREUTILS 


01 $ parallel-moreutils Options -- Program 
with Arguments 

02 $ parallel-moreutils Options Program -- 
Arguments 

03 $ parallel-moreutils ufraw 


out-path-ready/ ... -~ *raw 


LisTING 4: FILE A 


al 
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easier (Listing 1). To use this option, you 
should use a command like nice or nohup. 
The options control the tool behavior pre- 
cisely. 

If a lock file already exists, then the tool 
will report this (Listing 2, line 3). Some- 
times you won't be able to generate lock 
files in /var/lock/ because you may lack 
permission. The program also notifies you 
of this (Listing 2, line 5). In this case, you 
should use another directory, like your 
home directory. 

Ickdo deletes the lock file that has been 
generated after the program terminates. 
However, the lock files do not contain a 
process ID. Such an ID would make it eas- 
ier to manually terminate a program if it 
has hung. 

Another tool, flock, comes in the util- 
linux package: 


LISTING 5: Fite B 


al 


Listinc 6: A XOR B 


$ combine A xor B 


a2 


a3 


sudo apt install util-linux 


This program has a similar functionality to 
Ickdo but comes with different options. lek- 
do‘s man page therefore states that this 
tool will probably not be available in future 
versions of the moreutils package. 


PARALLEL UTILS 

There are a variety of tools for starting mul- 
tiple programs in parallel, even with differ- 
ent arguments. All of these tools are named 
either parallel or something similar. The 
moreutils package contains parallel- 
moreutils tool. The simple syntax for the 
tool is not much different than that of other 
implementations (Listing 3, line 1). 

In addition, the tool supports a second 
syntax variant (Listing 3, line 3), which 
can also be useful. There the double hy- 
phen divides the RAW files that are defined 
by the pattern. By default, the software 
starts a process for each CPU core. There- 
fore this often significantly accelerates pro- 
cessing speeds. However, there is no linear 
correlation between number of cores and 
elapsed processing time since input and 
output operations constitute a bottleneck. 

The option -j < number > lets you con- 
trol the number of processes that start in 
parallel. It makes sense to keep < num- 
ber > smaller than the number of proces- 
sor cores. However, it is actually 
possible to make the 
number larger. Using -l 
< decimal number > , you can define the 
maximum load (this is a measure of sys- 
tem load) up to which the parallel- 
moreutils tool will start additional pro- 
cesses. Once the load exceeds this limit, no 
further processes are started until it falls 
below the limit. 

Itis possible to manu- 
ally manipulate the 
commands executed with parallel- 
moreutils, which makes it universally ap- 
plicable. There are two options for doing 
this. The -i option lets you rearrange the 
command. By default, you add the con- 
tents generated by an argument, such as 
the file names generated with *.raw, to the 
end of the command line. Using -i, the par- 
allel-moreutils tool replaces each occur- 
rence of {} in the command line with the 
text generated with its argument, such as 
the file names. 

With -n < number >, you define the 
number of arguments that parallel- 
moreutils will take in one step and then 
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pass onto the program that is its argument. 
You should not use this option in combina- 
tion with -i. 


ZRUN 

Tools like parallel-moreutils tend to gener- 
ate unusual effects, particularly with 
commands that are somewhat more com- 
plex. On the other hand, the small com- 
mand zrun is easy to understand and also 
use by virtue of its simple syntax. 


$ zrun <program with arguments> 2 


<compressed data> 


This program decompresses archives 
given as its arguments on the fly, thus 
saving space on the drive. In the current 
version, the program works with archives 
with formats including GZIP, BZIP2, Z, 
XZ, LZMA, and LZO. 

A typical use case involves editing a 
compressed text file. An attempt to to 
open this kind of file with an editor, such 
as nano, does not work (Figure 1). The 
zrun tool makes things look quite differ- 
ent (Figure 2). You can see in the title bar 
of the editor that zrun has generated a 
temporary decompressed file, which is 
then handed to the editor. 

zrun deletes the decompressed tempo- 
rary file after you’ve finished with it; 
therefore, all of the modifications are lost 
unless you save your edited file to a new 
uncompressed version under a different 
name. It is up to you to compress the new 
version of your file again. 

zrun has an additional feature. If you 
create a link to zrun in the form of 
z< program >, then the link starts as zrun 
< program > . For example, create a link: 


In -s /bin/zrun /tmp/znano 


You have now generated a temporary 
command called znano. Running znano 
< file > acts exactly the same as zrun 
nano <file>. 


COMBINE 
A second group of moreutils com- 
mands is used for processing or test- 


Listinc 7: A AND B 


$ combine A and B 
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Ubuntuuser(@ubuntuuser-XPS-M1330: ~ 


nano 2.6.3 File: /tmp/I 9zISGdOt-zrun.txt 


(ZT: Zrun 
@L:Tools like parallel-moreutils tend to generate unusual effects, particularly$ 
@LI:$ zrun <§§I>Program with Arguments<§§I> <§§I>compressed data<§§I> 


@L:This program decompresses archives given as its arguments on the fly, thus s$ 


@L:A typical use case involves editing a compressed text file. An attempt to t$ 


(@Bi: bO1-nano-xz.png 
(@B:Figure 1: Loading compressed files in the editor usually yields garbage. 


(GBI: bO2-znano-xz.png 
(@B:Figure 1: Data that has been decompressed on the fly with Zrun provides the $ 


i@L:Zrun deletes the decompressed temporary file after termination. Therefore al$ 


i@L:Zrun has an additional feature. If you generate a link to this program in th$ 
<C>zrun <I>Binary<I><C>. Using <C>ln -s /bin/zrun /tmp/znano<C>, you generate a$ 
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Get Help @@ Write Out @f} Where Is gi Cut Text g Justify 
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Figure 2: Data that has been decompressed on the fly with zrun provides the desired results in the 
editor. 


ing files. There are many differences 
among these programs. Most target 
text files, which is not surprising 
since these kind of files have been 
used for a multitude of tasks for 
many years. For example, configura- 
tion files and many log files are in 
plain text format. 

Traditional Unix tools are very power- 
ful for working with text files. These 
tools are all available under Linux. 
Even so, there are some special maneu- 
vers required for certain tasks. Such 
tasks would include logical linking of 
text files, something which the combine 
command makes possible. 

This command combines all of the 
lines of two files via a logical operator 
and then shows the results. The opera- 
tors include AND (logical and), OR (logi- 
cal or), NOT (not), and XOR (exclusive 
or). With the AND operator, only those 
lines that exist both in the first and sec- 
ond file are returned. The content of the 
text lines is irrelevant to the combine op- 
eration; however, it scans the text in its 
entirety. 

Below is the syntax for the command. 
You can replace every file with standard 
input using -. The operators you apply are 


LISTING 9: TSTEST.SH 


LISTING 8: TESTING WITH ISUTF 


echo "Here we go.” 


$ isutf8 lbicec.tmp sleep 3 

lbicec.tmp: line 1, char 15, byte 14: echo "three seconds later.” 
Expecting bytes in the following ranges: sleep 2 

00..7F C2..F4. echo “five Seconds have passed.” 
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ListinG 10; RUNNING WITH TS 


$ bash tstest.sh | ts 

Nov 28 14:23:15 Here we go. 

Nov 28 14:23:18 Three seconds later. 

Nov 28 14:23:20 five seconds have passed. 
$ bash tstest.sh | ts ,%c“ 

Mo 28 Nov 2016 14:30:35 CET Here we go. 
Mo 28 Nov 2016 14:30:38 CET three seconds 
later, 

Mo 28 Nov 2016 14:30:40 CET five seconds 
have passed. 

$ bash tstest.sh | ts -s 

00:00:00 Here we go, 

00:00:03 three seconds later. 

00:00:05 five seconds have passed. 

$ bash tstest.sh | ts -i 

00:00:00 Here we go. 

00:00:03 Three seconds later. 


00:00:02 five seconds have passed. 


LISTING 11: PIPES WITH PEE 


$ ./script.sh | tee outputl.txt output2.txt 
$ ./script.sh | pee „grep pattern“ „gzip -c 


> output.gz“ 
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recognized by the program independently 
of the way they are written. 


$ combine <file> 2 
<Operator> <file> 


Listings 4 and 5 show the two files 
used to demonstrate the different op- 
erations you can carry out on different 
operations using combine. Listing 6, 
for example, shows what happens 
when you use the XOR filter on A and 
B: You get all of the lines from the files 
that are not identical in both. 

The files A (Listing 4) and B (Listing 
5) have a two lines in common. Other- 
wise all of the lines are different. The 
tool filters the latter out via XOR. It is 
worth mentioning here that the B file 
is one line longer than the A file. 
Nonetheless, b5 appears in the output. 
This means that the tool even pro- 
cesses empty lines. 

In Listing 7, you can see what hap- 
pens when you use AND to combine A 
and B. Only the lines that are the same 
in both are shown. 


ISUTF8 

Text files on current Linux systems 
normally exist as UTF-8 coded data. If 
this is not the case, when you process 
them, unexpected stuff happens. It is 
a good idea to first check to see 
whether the coding is correct. You 
can test files using isutf8 from the 
moreutils package to determine 
whether the file is indeed coded as 
UTF-8. If the coding is OK, then there 
will not be any output. If not, the 


TABLE 2: PLACEHOLDERS 


software will indicate text that does 
not conform (Listing 8). 

The actual evaluation is performed 
as usual with the return values of the 
command. The tool outputs zero for 
UTF-8 files. There are a few options 
for modifying the behavior of isutfs. 
For example, -q, or --quiet, suppresses 
the message that a file does not con- 
form to UTF-8. Using -l, or --list, you 
can specify that the software outputs 
only the names of nonconforming 
files. Using -i, or --invert, only those 
files that conform to UTF-8 are shown. 


TIMESTAMPS 

Timestamps are made up of short strings 
containing the current time. These are 
used for things like dating entries in the 
log files. The moreutils package comes 
with the ts tool. It has a command that 
adds a timestamp to the beginning of 
each line of STDOUT output. These 
timestamps let you monitor things like 
how long a command is taking to com- 
plete before passing control to the next 
command. 

Take the script, tstest.sh, in Listing 9, 
for example. Listing 10 shows what the 
output looks like using ts combined 
with different options. 

The tool constructs these timestamps 
with the strftime function. This func- 
tion is like the one used in the date 
command. It is possible to adapt the 
output using placeholders in the form 
of short character strings, such as %s 
and %D. Each of these strings repre- 
sents a particular aspect. You can learn 
more about the possibilities with man 3 


Abbreviation Function 
The number of seconds that have passed since 1.1.1970 00:00h 
%b Abbreviated name of the month 
%d za Day of the current month, decimal (1..31) 
%H Hour of the current day, decimal (0..24) 
%M Minutes in the current hour, decimal (0..60) 
%S Seconds in the current minute, decimal (0..60) 
%x Local date, without time of day 
%X Local time of day 
%c peal date, with time of day, in the format: Fr 04 Nov 2016 13:33:44 
%R Time of Day in 24-hour format 
%T Corresponds to %H:%M:%S 
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strftime. Table 2 contains a summary of 
the most important character strings. 

By default, ts uses the format ”%b 
%d %H:%M:%S” for output. You can 
specify another format with quotation 
marks for the last argument or as the 
argument for the -s option. 

There are some additional options for 
controlling the tool. The software con- 
verts given timestamps into relative 
amounts with the -r option. In testing 
however, this option only works for 
stamps that have been generated in the 
default format. With -i, the software 
computes the difference between the 
current and the previous timestamp. 


VIDIR 

There are some situations that require 
you to manually modify outputs pro- 
duced by commands like ls or find. 
Most of the time, this is done during 
preparations for other actions. For ex- 
ample you may want to prepare an ar- 
chive or process files directly, such as 
deleting a bunch of files. 

The moreutils package has a special 
tool, vidir, that does exactly this. It 
loads the contents of a directory that by 
default will be the current directory, or 
it can load specified parts of the direc- 
tory (vidir *.jpg) to a preset editor. The 
environment variable $EDITOR, or al- 
ternatively $VISUAL, define this editor. 
In order to edit the search results ob- 
tained, you should pipe the results from 
find into vidir. This means you will be 
able to do things like edit subdirectories 
with find | vidir -. 

The format used by the program is 
somewhat surprising at first. Each line 
begins with a line number which vidir 
uses after the editor shuts down as a 
way to figure out which files are to be 
removed. For example if you delete line 
18 of the temporarily created file in the 
editor, then vidir attempts to delete the 
file contained in line 18 as well. The 
analogous action of creating files this 
way does not work. However, you can 
rename files by changing the name in 
the file. These name changes are ac- 
complished by reversing the line num- 
bers. 

The capability of vidir is highly depen- 
dent on the power of the editor that is 
used. For example, Emacs lets you per- 
form complex, rule-based substitutions 
and deletions. Having said this, this par- 
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ticular editor comes with its own very 
powerful interface for the filesystem. 


MISPIPE 

Pipes rank among the most powerful 
constructs in shells. Indeed there is no 
more effective mechanism for transfer- 
ring data between different processes. 
Consequently, pipes are used... a lot. 
However, by default, many shells only 
evaluate the return value of the most re- 
cent command of a pipe. If one of the 
previous commands called in the pipe 
results in an error, then the shell will ei- 
ther not notice this, or it will not re- 
spond adequately. This can happen for 
example in a short circuit test, ||, &&. 

Many pipes consist of just two com- 
mands. The first generates the data, and 
the second processes it. At this point, it 
would be important to react if an error 
has occurred during the first step. This 
is where mispipe comes into play. It 
evaluates the return value of the first 
command. 

The command below always gener- 
ates the output Ooops when there is no 
file matching the missing* pattern. This 
occurs because the ls command has 
generated a return value of 2. The re- 
turn value for the grep command 
doesn’t matter here. When the ls com- 
mand detects matching files, grep filters 
out all of the lines containing a 1. 


$ mispipe „ls -1 missing*" 2 
„grep 1“ || echo Ooops 


PEE 


The rude sounding pee command was 
also developed for use in pipes. This is 


LISTING 12: EDITING WITH VIPE 


$ man less | vipe | cat 
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LISTING 13: FILE.TXT 


LISTING 14: SORTING WITH SPONGE 


$ sort -u file.txt | sponge file.txt 

$ cat file 

3 

5 

7 

$ sort -r file.txt | sponge -a file.txt 


$ cat file.txt 


TABLE 3: IFDATA: IMPORTANT OPTIONS 


Meaning 


Option 


-e Tests whether the interface 
exists 

-pe yes: the interface exists, oth- 
erwise no 

-pa IPv4-addresses for the inter- 
face 

-ph Hardware addresses of the 
interface 

ja 

-si Input Statistics 

-sip Number of input packages 

-sib Number of input bytes 

-sie Number of input errors 

-S0 Output statistics 

-sop Number of output packages 


-sob Number of output bytes 


Number of output errors 


== — 
-bips Input bytes per second 
-bops | Output bytes per second 
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the counterpart to the file-oriented tee 
command (Listing 11). tee outputs the 
output of a script or program to two 
files and STDOUT. pee, on the other 
hand, distributes the output to two 
pipes (so it can be used by another 
program) and omits it on STDOUT. 


VIPE 

The vipe program makes it possible to 
use editors between pipes (Listing 12). 
At first glance, this might seem to be of 
limited value since pipes connect the 
STDOUT channel of the first command 
to the default input of the second com- 
mand. Sometimes it makes sense to edit 
data before the processing continues in 
order to save storage along the way. 
vipe first reads in the entire dataset, 
processes it, and then passes the results 
on after the editor is finished. As with 
vidir, vipe also evaluates the variables 
EDITOR and VISUAL as part of designat- 
ing the editor. 


SPONGE 
The sponge command is also suitable 
for use in pipes. The shell does offer 
the possibility of redirecting data at 
any time to a file for transfer. The data 
is continuously deposited in pieces 
(usually line by line) in a file through- 
out the entire run of the command 
line, or pipeline. 

sponge does this in a different way. 
It first collects all the data internally 
and then transfers it to a file all in one 
go at the very end of a run. Among 
other things, this makes it possible to 
use the same file for input and output. 

Take for example file.txt shown in 
Listing 13. When no output file has 
been designated, the program uses the 
standard output channel. If an output 


LISTING 13: FILE.TXT 


$ errno eio 

EI0 5 Input-/Output error 

$ errno 5 

E10 5 Input-/Output error 

$ errno -s Output error 

E10 5 Input-/Output error 

EREMOTEIO 121 Input-/Output error of the 
remote 

$ errno -l | grep 121 

EREMOTEIO 121 Input/Output error of the 


remote 


file exists, it preserves its permissions. 
The -a option, shown in the second ex- 
ample of Listing 14, appends the out- 
put to the contents of the file. 


HANDLING ERRORS 

There are a number of Linux tools like 
strace that output very cryptic messages 
concerning supposed errors. Normally 
you would look up the symbolic name 
by means of: 


man 3 serror number> 


in the hope that the description offers 
some help. 

It is much easier to match up names 
and suitable numbers by using errno 
(Listing 15). The -s option (--search) lets 
you search among the list of error mes- 
sages for a particular term independently 
of its spelling. In addition, the program 
looks via -S for all man pages that have 
been installed in other languages. Occa- 
sionally, you get additional hits this way. 
Searching by error number does not 
work like this. Instead you should use 
the parameter -l to have errno output all 
of the error messages and then search 
through the list with grep. 


NETWORK INTERFACE 

The ifdata command checks to see 
whether a particular network interface 
exists and is active. It is possible to 
query the interface for statistics. The 
simple syntax used by the 


ifdata <Option(s)> <Interface> 


pattern, makes it clear that the com- 
mand is primarily designed for use in 
scripts. Table 3 lists the most important 
options of ifdata. 


CONCLUSION 

In addition to some truly helpful tools 
like pee and ts, the moreutils package 
has very special tools for a wide variety 
of tasks. Many users can probably do 
without many of the utilities, but if you 
are someone who writes a lot of scripts, 
then you will quickly come to appreciate 
the useful shortcuts they afford. e 


INFO 
[1] moreutils: http:/joeyh.name/ 
code/moreutils/ 
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SECURITY TOOLS 


Let's face it: Except for the most paranoid (or best-informed) of us, security is a drag — it's what you 
have to deal with before you can get on with real work. Luckily, Ubuntu comes with a complete 
toolset of security utilities that make the process much less paintul. 


Nine easy security tools 


HEALTH & SAFETY 


BY BRUCE BYFIELD 


he trouble with security is know- Most people know enough to install 
ing where to start. Security in- some sort of antivirus tool like Cla- 
volves the entire operating sys- mAV [1] and anti-spam filters such as 
tem and can require an intimi- SpamAssassin [2] and Bogofilter [3]. 
dating amount of expertise. So how can However, antivirus protection is low 
you secure your machine without mak- priority on Linux, unless a system ex- 
ing security a lifetime study? changes files regularly with Windows 


machines. Moreover, both antivirus 
and anti-spam tools are reactive secu- 
rity, useful only after you already have 
a problem. Your security is almost al- 
ways much tighter if you focus your 
attention on architectural security - 
that is, settings designed to prevent in- 
trusions in the first place. 

Fortunately, not only are architec- 
tural security fixes common, but a few 
are easy enough for even new users to 
apply. Of course, that doesn’t mean 
that they might take time to apply. 
Sometimes ease-of-use may be only 
relative to similar tools and still re- 
quire a long and difficult learning 
curve. 

Within these limitations, the nine 
solutions listed here are among the 
easiest to apply. Between them, they 
cover most of the major areas of con- 
cern in security, and if you apply all of 
them, you can be reasonably sure that 
your system is protected. 


LYNIS 
Like the once-popular Bastille Linux, 
Lynis [4] does a security audit of your 
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system. In less than 10 minutes, it con- 
ducts over 220 tests, including some 
designed for major distributions, and 
provides a list of suggestions for im- 
proving a system’s security (Figure 1). 
Each suggestion links to a detailed on- 
line description of why the suggestion 
matters and possible options. The tests 
can be run from the root account for 
an overall architectural audit or from 
an ordinary account for penetration 
testing. 

Depending on the state of your sys- 
tem, Lynis can keep you busy for 
hours as you harden your system. But 
it directs your efforts and teaches you 
more about the inner workings of 
Linux than anything else available. 
Run it as soon as possible after instal- 
lation, then as part of your regular 
maintenance, comparing the results of 
the two most recent audits to see what 
has changed, and check it. 


FIREJAIL 

Sandboxes - isolated environments - 
have become a standard security fea- 
ture in the last few years. Usually, that 
means running containers, which can 
be difficult to install. Firejail [5] is an 
easier alternative, installing light- 
weight sandboxes and running primar- 
ily on standard kernel modules (Figure 
2). Using it is as easy as adding Firejail 
at the start of a command. Create a 
panel or desktop launcher, and 
launching an application in a sandbox 
is reduced to a single click. 

Firejail installs with over 60 profiles 
for common applications like Firefox, 
XChat, and Wine, and a default profile 
for other applications. This basic secu- 
rity can be supplemented by compiling 
Firejail for AppArmor support, a 
whitelist or blacklist, and a range of 
other options, including an array of 
permissions. 

Like any form of sandboxing, Firejail 
should not be your only line of de- 
fense. However, it remains a valuable 
addition to your security toolbox. 


SIGNAL 

Developed by the non-profit Open 
Whisper Systems, Signal [6] encrypts 
voice and text messaging on Android 
and iOS phones (Figure 3). Signal 
Desktop, a Chrome app, is currently in 
beta, allowing users to take advantage 
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Figure 3: Signal encrypts voice and text conversations through its centralized servers. 


of a laptop or workstation’s larger 
screen and full-sized keyboard when 
using a linked phone. 

The phone apps are drop-in replace- 
ments for the default apps, installing 
seamlessly despite the warning issued 
by the phones. Conversations are car- 
ried by Open Whisper’s servers, with 
the exchange of encryption keys done 
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Figure 4: Despite its reputation as a conspirator's tool, BleachBit has several legitimate uses. 
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DSL connection, choose eth0, Choose pppO if you know your cable or DSL operator uses | 
| 


Network device setup 


Please select your Internet connected network device from the drop-down | 


Figure 5: FireStarter is one the easiest ways to set up a firewall when you lack expertise. 
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invisibly for the users. All participants 
in a conversation must have Signal in- 
stalled for encryption to be possible, 
but if they do not, then Signal still 
works unencrypted. 

Signal itself should be protected by a 
passphrase. You also have the option of 
setting an expiry date for each conver- 
sation and adding graphic and audio at- 
tachments to messages. 

However Signal’s use of centralized serv- 
ers could be a potential security risk. There 
are also some proprietary components on 
the backend. You might prefer similar but 
decentralized solutions such as Ring [7]. 


UMASK 

umask [8] is the standard command in 
Linux for setting the default permis- 
sions for a new directory or file. It sets 
the permissions for the owner, the 
owner's group, and other users, set- 
ting whether each can read, write, or 
execute a file. 

By default, most distributions set 
umask laxly, giving users all these per- 
missions, while the owner’s group and 
others can read the file. By denying 
the group and others read permis- 
sions, you substantially limit an in- 
truder’s navigational abilities within 
your system. Read the man page for 
chmod to refresh your memory about 
other ways to use permissions. 


BLEACHBIT 

BleachBit [9] is a multipurpose utility 
(Figure 4). Its original purpose was to 
identify files that could be safely de- 
leted, such as web caches, HTTP and 
Flash Cookies, unused localizations, 
and temporary log files that have out- 
lived their usefulness. 

For those who like to optimize their 
systems, this functionality remains im- 
portant. Today, however, BleachBit is 
known primarily for its ability to shred 
files and wipe unallocated disk space. 
In fact, these uses have become so no- 
torious that poorly informed people 
often assume that anyone who uses 
BleachBit must be a conspirator. How- 
ever, if you deal with sensitive infor- 
mation or are a privacy advocate, 
these are completely legitimate func- 
tions, and you should not be discour- 
aged from using BleachBit. 


FIRESTARTER 
Firewalls are a time-honored form of 
security. The problem is, even graphi- 
cal interfaces for setting up firewalls 
can be difficult to use unless you are 
well-versed in their structure. 
FireStarter’s [10] wizard is among 
the best interfaces available for setting 
up a firewall (Figure 5). Better yet, de- 
tailed instructions for specific distribu- 
tions, including Linux Mint [11] and 
Ubuntu [12], are available online. 


KeePassX 

Everyone knows strong passwords are 
a basic security feature. Yet many 
users avoid them because they are dif- 
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ficult to apply - or, worse still, keep 
them on a Post-it note taped beneath 
their keyboards. 

Password banks like KeePassX [13] 
are a reasonable solution, storing 
passwords in a secure environment 
and helping you generate strong pass- 
words and avoid the temptation of 
easy-to-remember weak ones (Figure 
6). KeePass, a command-line version, 
is also available. 


ENIGMAIL 

Most modern email readers support 
encryption. However, too many give 
no indication of how to encrypt. For- 
tunately, the Free Software Founda- 
tion has released a page called “Email 
Self-Defense” [14] that explains how 
to encrypt in Thunderbird with Engi- 
mail [15] using PGP (Pretty Good Pri- 
vacy). 

Besides explaining where to find 
and install Thunderbird and Engi- 
mail, “Email Self-Defense” explains 
how encryption keys work, how to 
generate them, and how to test the 
result. Each section contains a link 
for troubleshooting, and the last 
lines give general tips, such as the 
fact that the subject line is not en- 
crypted and should therefore not 
contain any sensitive information. 
Provided you have the patience to 
follow instructions, you should have 
the ability to encrypt email within 
half an hour. 


LOOKING FOR MORE 

If you configure all these tools, the 
end result should be a reasonably 
secure system. However, a basic 
axiom of security is defense in depth 
- meaning you can never have 
enough tools to keep your computers 
safe. 

The next time you install, consider 
encrypting your home directory. 
(You can do it later, but that im- 
mensely complicates the procedure.) 
If you are really serious, consider 
learning SELinux [16] or AppArmor 
[17] and writing your own security 
rules. Or, as fond as you may be of 
Ubuntu, you might consider switch- 
ing to Qubes OS [18], which builds 
different levels of security into the 
operating system and is available as 
a Debian derivative. 
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Figure 6: KeePassX not only makes strong passwords practical, but helps you to generate them as 
well. 


However, such extreme tactics are 
more than many users are willing to 
try. Stick with the suggestions here, 
and your system should be vulnera- 
ble to little except human engineer- 
ing, the exploitation of user gullibil- 
ity - and against that, nothing can 
protect you except common sense. e 


INFO 


[1] ClamAV: http//www.clamav.net/ 

[2] SpamAssassin: https:/spamassassin.apache.org/ 

[3] Bogofilter: http;/bogofilter.sourceforge.net/ 

[4] Lynis: https:/cisofy.com/lynis/ 

[5] Firejail: https:/firejail.wordpress.com/ 

[6] Signal: https:/signal.org/ 

[7] Ring: https:/savannah.gnu.org/projects/ring/ 

[8] Umask: https:/en.wikipedia.org/wiki/Umask#Displaying_the_currebitlockernt_mask 
[9] BleachBit: http:/www.bleachbit.org/ 

[10] FireStarter: https:/sourceforge.net/projects/firestarter/ 


[11] How to install Firestarter on Linux Mint: http:/www.wikihow.com/ 
Install-Firestarter-Firewall-on-Linux-Mint 


[12] How to install Firestarter on Ubuntu: http:/www.howtogeek.com/howto/ 
ubuntu/install-the-firestarter-firewall-on-ubuntu-linux/ 


[13] KeePassx: https:/www.keepassx.org 

[14] How to encrypt your emails: https:/emailselfdefense.fsf.org/en/ 
[15] Enigmail: https:/www.enigmail.net/index.php/en/ 

[16] SELinux: http:/www.selinuxproject.org/page/Main_Page 

[17] AppArmor: http:/wiki.apparmor.net/index.php/Main_Page 

[18] Qubes OS: https:/www.qubes-os.org/ 
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TUNING FIREFOX = 


Firefox tends to get sluggish pretty quickly when it is used intensively. There are some settings and 


add-ons available that can help it pick up speed again. 


DIETING 


BY ERIK BARWALDT _ 


ozilla Firefox is undoubt- 
edly one of the best web 
browsers available. 
Thanks to its modular 
construction, it can be configured 
very precisely and also expanded to 
include many additional functions. 
However, heavy Internet use can 


lead to sluggishness for this browser. 


It may start slowly and websites may 
also load slowly. There are a few 
maneuvers you can use to handily 
help Firefox regain its original 
speed. 


Many of the conveniences found in 
Firefox come at the expense of stor- 
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about your browser health 
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Update 


Helps you understand your browser performance and shares data with Mozilla 


a retnroez 


Certificates | 
| 


Learn More 


Learn More 


Allow Firefox to send backlogged crash reports on your behalf 
Crash reports help Mozilla fix problems and make your browser more stable and 


Learn More | 


Figure 1: You should deactivate the transfer of telemetric data to Mozilla. 


ing data, either temporarily or per- 
manently. This data is not limited to 
things like URLs you have visited 
over the Internet and the content of 
websites you have visited. The 
Mozilla corporation, which develops 
and maintains the browser, also col- 
lects numerous pieces of user data 
by means of a series of default set- 
tings in order to improve the soft- 
ware and to stay informed of its op- 
erating condition. 

Under Linux, you will see that 
large volumes of data quickly accu- 
ntulate in the $HOME/.mozilla/ 
firefox/ directory and its subdirecto- 
ries. In addition to status reports 
that the browser collects and trans- 
mits to Mozilla servers, these direc- 
tories contain crash reports and 
many other types of data. The soft- 
ware also saves up to five backups 
of your bookmarks even if you have 
used the corresponding dialog to 
save these externally. 

The browser does anonymize the 
data, but it also saves it locally 
without any set intervals for dele- 
tions. As a result, more and more 
garbage in the form of data collects 
over time in the relevant subdirecto- 
ries. In short, data continues to get 
collected and saved even though 
Firefox allows for deactivation of the 
individual functions under Advanced 
| Data Choices in the Settings menu. 

All of the so-called telemetry ping 
data that Firefox collects about the 
computer system via the current 
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browser version, various benchmark 
values, and extensions that have 
been installed ends up in duplicate 
also on the local system. The dupli- 
cates include a compressed and un- 
compressed version, both of which 
are available for transmission to the 
Mozilla servers. 


BLOCKADE 
The first thing you should do in 
order to eliminate data collection 
and random local storage is to 
switch off all of the report functions 
in the Settings menu (Figure 1). This 
prevents transmission of generated 
information, but it does not stop col- 
lection activities. Putting a stop to 
data collection requires going into 
the browser’s internal workings. 
Your next step is to open the Firefox 
configuration dialog by entering 
about:config in the address line. 
After confirming the alert mes- 
sage, you will find yourself in the 
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CE 


user set boolean faise 


toolkit.telemetry.cachedCllentiO user set string ‘31b7f071-9412-4016-8164-9cde5d9d6008 

[tooikit telemetry: debuestowsal detautt boolean false | 
[toolkit telemetry-enabled detauit boolean false 

toolkit. telemetryiinfouRt default string https://www.mozila.org/legaV/privacy/frefox.htmistelemetry 

rootkit. tetemeteypreviousBultdiD user set string 20170126005340 

toolkit.telemetry.reportingpollcy.firstRun userset boolean false | 
toolkit.telemetryserver detavit string hetps:/fincoming.telemetrymozila. org | 
toolkit telemetry server_owner default string Morita | 
toolkit telemetry.unified default boolean true | 


intervene in the browser's internal workings. 
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Preference rame A statu Type 


ttps://Thr.cdn.mozilta.net/#LOCALE%/v4/ 


re default string 
\datareporting healthreport.infoURL detautt string hetps://www.morilla.org/legal/privacy/firetox.htmishealth-report 
\datareporting.healthreport.uploadénabled user set boolean false 


\datareporting policy currentPolicyversion default integer 2 


1485551167806 

datareporting pobicy frstRunURL detavit string | 

|datareporting.policy.minimumPolicyversion default integer 1 | 

|datareporting.poticy.minimumPoticyversion.channel-beta default integer 2 

\datareporting sessions.current.activeTicks user set Integer 34 

datareporting.sessions.current.frst Paint: user set integer 6719 

\dotarepetig.scsons corsa la user set Integer 1400 

_datareporting sessions current.sesslonRestored user set Integer 11299 

ldtareprtingsessons.crrentstavtTine user set string 1486069129106 

datareporting sessions.current totalTime user set Integer 238 
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Figure 3: It is also possible to prevent collection and storage of local information. 


configuration editor. When you enter 
the expression toolkit.telemetry in 
the search field, a list of relevant ad- 
ministration options will appear. You 
should look for the following three 
entries: toolkit.telemetry.archive.en- 
abled, toolkit.telemetry.enabled, and 
toolkit.telemetry.unified. By double- 
clicking, you set each to false. This 
deactivates all data collection for the 
telemetry. 

If you want to be absolutely sure 
that the browser is not sending any 
data whatsoever to Mozilla, you 
should also delete the data in both 
of the lines toolkit.telemetry.server 
and toolkit.telemetry.infoURL (Fig- 
ure 2). 


Data REPORTS 

The web browser collects data on 
the status of the software and 
crashes in the subdirectory datare- 
porting within the hidden Firefox di- 
rectories. If no changes have been 
made to the default settings, the 
software will also transfer this data 
to the Mozilla servers. 

Even if the settings have been 
modified to prevent data transfer, 
Firefox continues to collect the data 
and store it locally. Although the 
amount of data collected each time 
is very small, intensive browser use 
can quickly lead to hundreds or even 
thousands of files for which you 
have no use. 

In order to permanently stop the 
browser’s habit of gathering up data, 
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Figure 4: The settings dialog in Cache Status 
regulates all of the important options. 


you will need to head over to the 
manual configuration dialog 
about:config page again and should 
look for the datareporting option. By 
double-clicking on the line datare- 
porting. policy.dataSubmissionEn- 
abled, you will set the option value 
to false if it was previously set to 
true (Figure 3). 

This procedure works a bit differ- 
ently for Firefox versions 40.x or 
lower. If you have one of these older 
versions, you should set the entries 
datareporting.healthreport.uploadEn- 
abled and toolkit.telemetry.enabled 
to false. In the interest of security 
regardless of the version you are 
using, you can also delete the ad- 
dress for the Mozilla servers. 


THE CACHE 

In addition to saving data perma- 
nently, Firefox also tries to speed up 
load times for websites through vari- 
ous means offered by caching. In the 
process, the web browser uses work- 
ing memory, the hard drive, and 
SSDs as a buffer. 

Especially when you are using an 
older hard drive that is slower, you 
will forfeit quite a bit of speed when 
there is frequent access to bulk stor- 
age. It therefore pays to keep an eye 
on the cache memory and to delete 
it if necessary. Although Firefox of- 
fers suitable options for this task in 
the Preferences | Advanced | Network 
menu, these settings are difficult to 
access and monitor. 

The Cache Status [1] add-on pro- 
vides a solution for these difficul- 
ties. When installed, you will see 
two icons to the right of the address 
field. These two icons constantly 
keep you informed of the current as- 
signment of memory space in kilo- 
bytes. This gives you an overview of 
the cache. 

You can set the maximum size you 


UBUNTU USER » WWW.UBUNTU-USER.COM 


@ Troubleshooting in... x 


| © Orneto aboutsupport 


This page contains technical information that might be useful when you're trying to solvea problem. if 
you are looking for answers to common questions about Firefox, check out our support website. 


| Troubleshooting Information 


Copyraw datatoclipboard  Copytext to clipboard 


Application Basics 


Firefox 


51.01 
20170126085340 


Show Update History 


Unux4.8.034-generic 
Open Directory 
‘about plugins 
about.buildeontig 
‘aboutimemory 
‘about:performance 

By sboutservikeworkes 
4/1 (Enabled by defaut) 
false 


Give Firefoxa tune up 
Refresh Firefox... 
Try Safe Mode 


Restart with Add-ons Disabled... 


Mozilla/5.0 (X11; Ubuntu; Linux x86_64;r¥:51.0) Gecko/20100101 Firefox/S1.0 


want for the cache memory using 
the add-on’s dialog. Go to Tools and 
then Add-ons and pick the Exten- 
sions tab (Figure 4). To empty the 
cache, you will need to right-click 
the icon in the address bar and se- 
lect Delete entire cache from the 
Context menu. Given all of the data 
privacy and security issues that may 
arise, it is a good idea to empty the 
cache after each session. 


RabIcaL DIETING 

Occasionally it happens that Firefox 
reacts very sluggishly to input while 
generating a high CPU load. The 
command-line tool htop helps you 
figure out whether it is the web 
browser that is slowing the com- 
puter down. If so, this could be be- 
cause add-ons have gotten out of 
control and caused a high system 
load. These loads might even lead to 
a system crash. 

In order to determine what is hap- 
pening, you should start Firefox in 
safe mode, which in turn deactivates 
all of the installed add-ons and 
themes. You can initiate a safe start 
by picking the option Restart with 
Add-ons disables... from the browser 
Help menu or using the command- 
line call firefox --safe-mode. 

If the browser now works signifi- 
cantly faster and does not cause any 
further problems, you should sys- 
tematically disable all of the in- 
stalled add-ons that and then reacti- 
vate them one by one. There is a de- 


Figure 5: Firefox offers a feature that allows for a complete reset to factory settings. 


scription for the easiest way to do 
this on the support page which you 
can open by entering about:support. 

This page provides plenty of infor- 
mation about the libraries, modules, 
and add-ons that are used, as well as 
modified browser options. If you 
click at the top right on the Refresh 
Firefox ... button, the software will 
delete all of the add-ons, as well as 
some of the settings (Figure 5). This 
also affects changes that have previ- 
ously been made to the configura- 
tion. The bookmarks, any open tabs, 
and saved passwords that have been 
activated all remain untouched. 

Generally, it is a good idea to acti- 
vate a thorough cleaning like this 
only after you are sure that the add- 
ons are not responsible for the 
heavy load on the hardware. 


CONCLUSION 

Firefox tends to get less responsive 
with long sessions and the installation 
of lots of add-ons. Caches and log 
functions also increase the amount of 
memory required. The well-engineered 
concepts in this web browser help 
even the less experienced user put the 
browser on a sustainable data diet. 
This in turn leads to improved work 
speed. Regularly deleting the cache 
and switching off unnecessary log 
functions also gives you better data 
privacy and security protection. Track- 
ing your search behavior does not 
work without these files. This applies 
to both local tracking and telemetry. « 
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INFO 


[1] Cache Status add-on: https:/ 
addons.mozilla.org/en-US/firefox/ 
addon/cache-status/ 
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RIGIN 


There is hardly a website out there that doesn't have advertisements and trackers. Some sites are 
practically flooded with them. Ad blockers like uBlock Origin can be used as effective 
countermeasures. 


Testing the uBlock Origin ad blocker 


CLEAN SLAT 


BY ERIK BARWALDT 


he advertisement industry likes to 

spy on Internet users as much as 

possible. Partly, this is because 

the industry wants to deliver the 
most appealing and successful ads possi- 
ble. At the same time, collecting data 
that can then be offered for sale is also a 
goal. It is becoming increasingly difficult 
for users to extract themselves from 
these practices. However, innovative de- 
velopers are up to the task. 

Modern web browsers like Mozilla 
Firefox and Google Chrome/Chromium 
have a modular design that makes it eas- 
ier to use extensions for keeping the sys- 
tem secure from a wide range of online 
dangers. These extensions are also good 
at creating a bulwark against spy tech- 
nologies and intrusive advertising. 

Along side the increasingly clever ad- 
vances in spy technologies, there have 


been correspondingly greater efforts 
made to immunize browsers from intru- 
sions by traditional means. There are 
many different extensions to choose 
from. Favorites among these include the 
ad and tracking blockers Adblock Plus 
[1] and Ghostery [2]. Both of these pro- 
grams are partly based on filter lists that 
the community and manufacturers main- 
tain and update constantly. 
However, these add-ons come with 
disadvantages. Ghostery has to be man- 
ually installed using a wizard that is 
both inconvenient and demanding in 
terms of the required level of prior 
knowledge. The default settings for Ad- 
block Plus give a free pass to a few 
“non-intrusive” advertisements. As it 
turns out, the providers of Adblock Plus 
are paid by website operators for these 
ads, which makes the add-on very sus- 
pect. Axel Springer, the German pub- 
lisher, previously sought to counter this 
practice by bringing a lawsuit. 
Moreover, an increasing number of 
content providers check to see when the 
website is called up whether the client 
uses ad blockers. If so, the site refuses to 
display the contents. Therefore, if you 
want to view content from websites like 
these and also have your ad blocker 
switched on, you will need a browser ex- 
tension that uses scripts to override the 
ad blocker. This creates additional con- 
figuration work and also noticeably 
slows down the web browser due to in- 
creasing numbers of installed add-ons. 
To make matters worse, there are secu- 
rity issues associated with the browser 
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tools themselves. These issues became a 
matter of note with the data scandal 
caused by the add-on Web of Trust. 
Some tools promise increased data pri- 
vacy but spy on the user instead. At one 
point, even the Ghostery tool, which was 
developed by a New York City company 
of the same name, came under suspicion 
for collecting user data and selling it to 
advertisers. However, it is possible to 
turn off the data transfer feature of the 
tool by switching off the activated 
Ghostrank found in the basic setting. 

Eyeo GmbH from Cologne, Germany, 
which maintains and develops Adblock 
Plus, has also met with criticism for its 
business model. This add-on has default 
settings that designate particular adver- 
tisements as non-intrusive, so it lets 
them pass through; however, you can 
deactivate this option. Basically, it is a 
good idea to carefully configure any ex- 
tension before using it in order to avoid 
these kinds of stumbling blocks. 


SweePinG BLow 

The program uBlock Origin [3] origi- 
nated with uBlock [4], which is still 
maintained by volunteer developers but 
no longer developed (see the “uBlock - 
The Original” box). The uBlock Origin 
project is relatively young to be taking 
on the task of putting an end to the 
chaos that exists among the ad and 
tracking blockers, but it seems that it’s 
going to try. 

You can get uBlock Origin for Firefox 
or Chrome at their respective sites for 
add-ons. When installed, the tool places 
a symbol in the address bar of the 
browser between the Bookmarks and the 
Settings menu. With Google Chrome, 
uBlock Origin also offers a web socket 
for collecting and filtering alternative 
data streams. However, once installed, 
there are no further possibilities for cre- 
ating settings. 

In Firefox, a click on the uBlock sym- 
bol opens a small status window in 
which you open the extension’s configu- 
ration page by clicking on the version 
number. The configuration page con- 
tains multiple tabs, all arranged horizon- 
tally. The tabs allow for precise adjust- 
ments of all of the options (Figure 1). 

In the Settings tab, you can set some 
basic options. These include specifica- 
tions for the home screen’s appearance 
and modifications for the browser’s be- 
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Figure 1: There are extensive settings options in uBlock Origin. 
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Figure 2: In contrast to a program like Adblock Plus, uBLock Origin has a large selection of filter 
ists to use for various purposes. 
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havior. In the 3rd-party filters tab, to the 
right of the first tab, you can adjust tool 
efficiency by integrating suitable filter 
ists. 

Immediately after integrating the lists, 
you should definitely activate the Auto- 
update filter lists option by marking the 
checkbox. Then click on the Update now 
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Figure 3: It only takes a few mouse clicks to add your created filters to uBlock Origin. 


button to trigger an update. Underneath 
these options, you will see several 
groups with various filter lists that can 
be activated by setting a check mark 
(Figure 2). 

Unlike Adblock Plus, which has only a 
single selection list for filters, uBlock Or- 
igin has lists of domains that distribute 
malware and sites that spy on user 
search behavior by means of hidden 
technologies like pixel counters. 

For users who regularly travel to other 
countries, the extension offers additional 
filter lists in the Region, languages sec- 
tion. These filters make sure that the ad- 
vertisements coming from the corre- 
sponding foreign countries do not make 
it into the browser. 

Another special feature is the Anti-Ad- 
block-Killer | Reek filter. This is a script 
that the browser normally executes 
using the Greasemonkey add-on. The 
script prevents websites from locking 
their content when the client making a 
request is running an ad blocker. Reek 
also works in uBlock Origin, even if 
Greasemonkey has not been installed. 
However, tests showed that it is not ef- 
fective with certain sites. For example, 
the sites for Forbes.com and Wired.com 
granted access, but the site for the Ger- 
man newspaper Suddeutsche.de re- 
mained inaccessible. 

If needed, you can use the lists under 
Social to deactivate the “Like” buttons 
that frequently appear for various social 
media sites like Facebook and Twitter. 
These buttons also collect visitor data 
and record your online behavior. 


As soon as you select one of the lists 
and options, you will need to activate it 
by clicking on the Apply changes button 
at the top right of the window. The soft- 
ware will then download the new filter 
lists from the Internet. This will take 
some time when there are a lot of acti- 
vated filters. 

For each filter, the extension displays the 
number of existing entries and their activa- 
tion status. Clicking on the filter opens its 
definition as a text file in the browser. 


In Your HANDS 

You can define your own filter rules as 
desired in the My filter tab. You can also 
import filters from Adblock Plus, or you 
can export filters that you have set up 
yourself. Integrating new entries into the 
list is accomplished by right-clicking on 
the element in each website that is sup- 
posed to be filtered and selecting Block 
Element from the pop-up menu. 

You will see the browser window go 
dim. In the lower right, a superimposed 
window will open with the blocking 
rules. This window will brighten when 
you roll over it with the cursor. Add the 
new filter rules to the window by click- 
ing on the Create option. The blocked el- 
ement then disappears from the website 
(Figure 3). Simultaneously, a new entry 
appears in the list of the filters you have 
created. 

If needed, you can define more of your 
own filter rules under My rules. The tool 
will apply these to websites indepen- 
dently of individual elements. The man- 
ual entries necessary here require a cer- 
tain skill level. Instructions for the com- 
mand syntax can be found by clicking 
on the full documentation link. 

You can enter hostnames that uBlock 
Origin should not filter in the Whitelist 
tab. You can also exchange this data 
with other applications using the Import 
and append and Export options that are 
offered here. 


Status SYMBOL 

Once you are done configuring, uBlock 
Origin can display statistical data about 
the blocked elements when the browser 
calls up a website. In order to see this 
data, click on the icon in the address bar. 
Additionally, you can temporarily modify 
some settings for the active site by click- 
ing on one of the icons found below in 
the status display. This lets you do things 
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Browse our shop for single issues of ADMIN, Linux Pro, 
Linux Magazine, Ubuntu User, Drupal Watchdog, and 
Raspberry Pi Geek — delivered right to your door. 


Æ shop.linuxnewmedia.com/single 


Better yet, subscribe, and you 
won’t need a bookstore. 


Æ shop.linuxnewmedia.com/subs 
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like make pop-up windows go away or 
prevent larger media files from loading. 
Temporary modifications prove useful 
when you need to enter data in a pop-up 
window that the add-on would other- 
wise block by default. In general, you 
can specify the maximum size permissi- 
ble for the loading of media files in the 
configuration dialog’s Settings | Default 
behavior tab. The default value is 50KB. 
If the browser content no longer dis- 
plays due to a configuration that is 
overly restrictive, you can turn off the 
extension completely with a click on the 
large on/off symbol. This action will 
apply either to the active website or gen- 
erally to all of the sites on one domain. 
If you want to see how uBlock works in 
real time, click in the status window on 
the table icon for Open the logger. An 
empty window will open where all of the 
connection queries will gradually appear. 
The queries handled by the extension will 
be designated with a color (Figure 4). 
When a filter catches a query (marked 
in red), clicking on the match pattern in 
the second column opens the corre- 
sponding list. You can get the details for 
each hit by clicking on the match proba- 
bility. This opens a new window where 
you can modify the filter according to 
your needs. 


PRACTICE TEST 

During testing, | compared the efficiency 
of uBlock Origin with the performance 
of the Adblock Plus and Ghostery duo. I 
used Firefox ESR 45.4.0 for the test sys- 
tems. I found that the web browser was 
noticeably more agile with uBlock than 
it was with Adblock Plus and Ghostery. 
Advertisement filtering was equally ef- 
fective with both uBlock Origin and Ad- 
block Plus. 

uBlock Origin stood out because it 
makes Greasemonkey superfluous, thus 
also saving resources. Adblock Plus, on 
the other hand, requires Greasemonkey 
for deactivating ad-block locks. uBlock 
and uBlock Origin demonstrate far less 
efficiency, however, when filtering track- 
ing software like pixel counters. 
Ghostery came out way ahead in this re- 
gard. 

Therefore, it is a good idea to use 
Ghostery or TrackerBlock [5] alongside 
uBlock Origin. Both of these filter all 
tracking software on websites and pre- 
vent the creation of a search profile. 
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Figure 4: By choosing Open the logger, you will be able to see all of the connection queries in real 
time. In the process you can also edit filters manually. 


Combining these tools with uBlock Ori- 
gin won’t slow Firefox down in any per- 
ceptible way. They do, however, reliably 
cleanse websites of unwanted elements. 


CONCLUSION 

Securing your web browser against at- 
tacks by intrusive advertising and un- 
wanted bugging mechanisms remains 
inconvenient and time consuming. That 
said, uBlock Origin reduces configura- 
tion efforts by virtue of the fact that it in- 
cludes a large collection of add-ons, 
making the browser itself lean and 
speedy. In order to also get rid of track- 
ers, you will still need to use Ghostery or 
TrackerBlock. When using Ghostery, you 
should switch off the Ghostrank function 
since the extension will otherwise trans- 
fer data on your search behavior to the 
project. e 


UBLOCK — THE ORIGINAL 


The original uBlock is still available for 
various web browsers and has a very 
similar interface with nearly identical 
functions. However, during testing, | 
noticed that the older uBlock needed 
more memory than the newer version 
even though each had the same con- 
figuration. The same filter lists had 
been activated in each application, 
and they were updated at intervals of 
every few minutes. Nonetheless, 
uBlock required approximately 26MB 
of memory, while uBlock Origin made 
do with 18MB. 


INFO 


[1] Adblock Plus: https:/adblockplus. 
org/en/satari 

[2] Ghostery: https:/www.ghostery. 
com/our-solutions/ 
ghostery-browser-erweiterung/ 

[3] uBlock Origin: https:/github.com/ 
gorhill/uBlock 

[4] uBlock: https:/www.ublock.org 

[5] TrackerBlock for Firefox: https:// 
addons.mozilla.org/en-US/firefox/ 
addon/trackerblock/ 
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Keeping an eye on possible changes to the filesystem can prove very beneficial. It can also help 
you to automate many processes. 


Using inotify to monitor the filesystem 


UNDER CONTROL 


BY KARSTEN GUNTHER 


t always happens that as soon as you 
have created or changed a particular 
file, you want to start compiling, gen- 
erate an archive, or upload the file to a 
server. Previously you turned to some sort 
of so-called “busy waiting” tool. Now the 
inotify tools accomplish the task much 
more conveniently and elegantly [1]. 

A busy waiting tool is a program that 
runs in an endless loop, repeatedly calling 
up the same information. An example 
would be a script that monitors the con- 
tents of a directory. The program com- 
pares the information with previously col- 
lected data and triggers when they are dif- 
ferent. However, this process is ineffec- 
tive. In the worst case scenario, it can also 
damage the data storage device. 


It would be much better if monitoring 
was automated. The kernel could then 
use a special interface to notify all of the 
programs that are waiting for a change 
to a file. The Amiga filesystem contained 
this technique. Under Linux, there is a 
corresponding function by the name of 
inotify (a name that was created by com- 
bining “inode” with “notify”). Linux 
uses inotify for certain entries in the file- 
system. 

With inotify, you select options to de- 
termine what changes to the files will be 
communicated by the kernel and how. 
All of the changes trigger events (see 
Table 1 for an overview). You should pay 
careful attention to the syntax that is ac- 
tually used — it can occasionally differ 
between programs, often times with re- 
gard to the use of lowercase and upper- 
case. The man pages for the programs 
contain instructions for dealing with er- 
rors. With SELF events, the monitored 
file ceases to exist after the message. 
This normally ends the monitoring pro- 
cess. 


LISTING 1: INOTIFYWAIT_EXAMPLE.SH 


#1 /bin/bash 


while dete; do 
inotifywait -e modify $1" 
makeindex -g -s k+g2.ist .$(1%2.*}. idx" 
nice xelatex ,$@* 


done 
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Listing 2: RUNNING IWATCH 


$ iwatch -c „command line“ [-C character 


set] [-e Event]... 


LISTING 3: EXAMPLE USING IWATCH 


The inotify man page documents the 
internal interface. You can call this via 
man 7 inotify. Regular users do not have 
direct access to events. Instead, a series 
of tools exists to help you evaluate the 
corresponding information in the shell 
and in scripts. The most important of 
these tools include: 

e inotify tools: Contains inotifywait and 
inotifywatch, which are two tools used 
for simple tasks. 

e iWatch: A very easy-to-use tool. 

e fswatcher: A complex tool with many 

functions. 

inotail: A version of tail that is con- 

trolled by inotify. Used as an alterna- 

tive to the tail -F < File > call. 

Fsniper: An inotify monitor with com- 

plex syntax and controlled through 

configuration. 

e Watchman: An inotify monitor con- 

trolled through configuration and has 

multitude of functions. 

Direvent: The GNU compatible ver- 

sion, not dependent on a particular 

system. 

This toolset can be expanded with other 

programs that offer similar functions. 

Additional applications like cron (in- 

cron), as well desktop search engines 

like Beagle, Strigi, and Recoll, get in- 
formed by inotify when new files are 
created or changes have been made to 
existing files so that these can be in- 
dexed. 

Direvent goes further than the typical 
inotify program. This GNU program can 


$ iwatch -c „a2x -v -a lang=en -f pdf -dbook 


route5-2016.adoc; date“ -e modify *.adoc & 


TABLE 1: INOTIFY EVENTS 
Abbreviation 


CLOSE_WRITE 


Format 
Access to the file(s) 
Metadata is modified 
File for writing closed 


use both inotify and other mechanisms 
to detect changes in the filesystem. Hav- 
ing said this, Direvent can only be used 


CLOSE_NOWRITE 
CREATE 


Write-protected file closed 


New file set up 


DELETE 
DELETESELF 


File deleted 
Monitored directory deleted 


MODIFY 


File modified 


MODIFYSELF 
MOVEDFROM 
MOVEDTO 


Monitored directory modified 


File moved from the monitored directory 


File moved to the monitored directory 


OPEN 
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File opened 


via a configuration file and is therefore 
not suitable for use on the command 
line or in scripts. 


INOTIFY TOOLS 

The inotify tools are suitable for use on 
the command line and in scripts. inotify- 
wait and iWatch are the best here. 

With inotifywait, you define the files 
to monitor and the events that should be 
evaluated. As soon as a relevant situa- 
tion occurs, it terminates, and a script or 
a shell function executes the next com- 
mand. This command then calls the de- 
sired action. Normally, inotifywait is 
used in a loop so that it can react to as 
many events as possible. 

Listing 1 shows a typical script for this 
tool. The modify command monitors the 
file that the first argument, $1, has desig- 
nated for changes. The advantage to this 
method is that a random number of ac- 
tions execute when the event occurs. 
The actions here involve making an 
index and, if applicable, the creation of a 
glossary. 

The Bash routines use the 
”"${1% %.*}.idx” parameter in order to 
generate the index file name from the 
name of the file that is being monitored. 
The file extension will be .tex. After 
completing the makeindex script, the 
source text gets recompiled. There is ab- 
solutely no error control in this script 
due to its pared down simplicity. As a re- 
sult, it doesn’t offer any options for 
doing things like checking the entry files 
or preventing a makeindex from crash- 
ing should an error occur. 


OPTIONS 

There are a number of options that can 
precisely control the behavior of inotify- 
wait. For example, the options -e 

<event > and -event < event > limit the 
type of events that the tool observes. If 
nothing is specified here, then inotify- 
wait evaluates all of the results. Both the 
-t <time> and --timeout <time> op- 
tions can indicate the wait time for the 
event in increments of seconds. Once 
this time period has passed, the program 
will finish even if the event has not oc- 
curred. 

The -r, or -recursive, option monitors 
the directories plus all of the subdirecto- 
ries. You should be cautious about using 
this option. For one thing, editing acci- 
dentally could cause unwanted changes. 
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Also, administering deep branches of the 
directory tree could take up additional 
resources. 

The @ <exception(n) > option ig- 
nores the designated file(s) during 
monitoring. This makes sense, espe- 
cially for automatically generated files, 
as is the case, for example, with back- 
ups. The --exclude < pattern > and --ex- 
cludei < pattern > options work in a 
similar fashion. They define patterns 
for the file names that should be ig- 
nored. The second option indicates that 
the differences between capitalization 
are ignored. 

The --fromfile < file> option defines 
the files that are to be modified by ref- 
erencing the file and the paths. The -m 
(--monitor) option makes sure that the 
program does not terminate but in- 
stead continues to work until an exter- 
nal signal comes in, for example, kill 
<PID>. 


INOTIFYWATCH 

inotifywatch, another inotify tool, 
works similarly to inotifywait except 
that it only collects information. It does 
not execute actions. The options in the 
program are almost the same as those 
in inotifywait. inotifywatch is primarily 
useful for identifying problems and get- 
ting an overview of what is currently 
happening in a filesystem or directory. 


IWATCH 

Another more straightforward possibility 
for starting a command or a script, 
which can then be used to execute mul- 
tiple commands, comes in the form of 
the iWatch tool [2]. It was developed 
with an eye for simplicity. Listing 2 
shows the syntax for the command. Or- 
dinarily it will not be necessary to enter 
this set of characters. UTF-8 is preset. 

If you designate command lines as an 
argument of -c and the lines contain 
empty spaces, then you will need to en- 
close these with single quotation marks. 
The single quotation marks prevent shell 
functions from expanding, whereas dou- 
ble quotation marks permit expansion. 
The quotation marks also make it possi- 
ble to use complex command lines with 
‘individual commands separated with 
semicolons (;). Interestingly enough, the 
possibility of accessing certain parts of 
the event also exists here. For example, 
the place holder %e stands for the name 


of the event and %f for the path and 
name of the triggering file. 

Listing 3 shows a simple example that 
uses iWatch. By using *.adoc, each mod- 
ification to the ASCIIDOC source texts 
triggers a new processing event. The 
program does this by recompiling the 
“master” file routeS-2016.adoc with a2x. 

The -r option causes iWatch to work 
recursively. Using -d, you switch the pro- 
gram into daemon mode, similar to inoti- 
fywait -d or inotifywait -m. In this mode, 
it is a configuration file that essentially 
controls the behavior of the program. 
With -t, you activate a list of positive fil- 
ter functions. The iWatch tool evaluates 
the list when monitoring the files. 

While the workings of iWatch are sim- 
ple, there are two downsides. Since the 
program is written in Perl, you need to 
resolve a number of dependencies. Prac- 
tically speaking, this means that con- 
flicts regularly occur among the ver- 
sions. In these situations, the only thing 
to do is to uninstall and remove all of the 
dependencies and then reinstall the pro- 
gram. The other downside is that iWatch 
does not have a man page. Instead, the 
option -h takes you to extensive help. 

You will find complete documentation 
of this program on the homepage [3]. 
There you will also learn how to define 
the files that should not deliver a trigger 
by using the -x <Exception(n) > and -X 
< Pattern > options. 


NOTEWORTHY 

The number of monitored files sup- 
ported by the kernel defines a value in 
the pseudo file /proc/sys/fs/inotify/max_ 
user_watches. You will often find that 
the default values are quite low, 8,192 
being a common number. You can easily 
exceed this limit if you perform test 
monitoring on a home directory that is 
somewhat full (Listing 4, Line 1 to 4). 
However, you can to adjust the value at 
any time using root rights (Listing 4, line 
2) 

When configuring programs like in- 
cron, it makes sense to proceed with 
caution. Tools like this are frequently 
used for monitoring larger directory 
trees. If you do not take extreme care, it 
is possible that endless loops may occur 
since incron deposits results in files that 
are located in monitored regions. In the 
worst case scenario, these kinds of loops 
can even crash a system. e 
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LISTING 4: MAXIMUM NOTIFICATIONS 
01 $ inotifywatch -v -t 60 -r~ 

02 Establishing watches... 

03 Setting up watch(es) on ~ 


04 Failed to watch ~; upper limit on inotify 
watches reached! 


05 $ cat /proc/sys/fs/inotify/max_user_ 
watches 


06 8192 


07 $ echo 16384 | sudo tee /proc/sys/fs/ 
inotify/max_user_watches, 


08 16384 


09 $ cat /proc/sys/fs/inotify/max_user_ 
watches 


10 16384 


INFO 


[1] Inotify Tools: https:/github.com/ 
rvoicilas/inotify-tools 


[2] iWatch: http:/iwatch.sourceforge. 
net/index.html 


[3] Documentation: http://iwatch. 
sourceforge.net/documentation. 
html 
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ONLINE LATEX 


You can edit your LaTeX documents with online editors that run across platforms and are device 
independent. Documents get saved online, thus giving you and other members of a work group 
easy access from anywhere. 


Online LaTeX Editors 


SKY WRITING 


BY DANIEL TIBI 


nline editors for LaTeX docu- 
ments cover a wide range of 
functionalities. At the most 
basic level, there is the formula 
editor, which uses LaTeX code for type- 
setting mathematical formulae. These 
formulae are then saved as image files 
for later use in an Office document. In 


addition, there are websites that simu- 
late full LaTeX editors. These editors let 
you edit using LaTeX code and, typically, 
allow you to download the completed 
document as a PDF file afterwards. 

Frequently, you will need to register, 
but once you do so, you will have access 
to a LaTeX editor and diverse templates, 
plus a storage location for your own doc- 
uments. In many cases, you can share 
your documents with other users who 
have read and write permissions. 


FORMULA EDITORS 

A formula editor is actually not a full 
fledged LaTeX editor. These editors gen- 
erate formulae from mathematical LaTeX 
code. You can download the formulae as 
image files and insert them into an Of- 
fice document. These types of editors are 
interesting to users who as a rule use Of- 
fice Suite to create documents, but who 
don’t want to forego the excellent results 
achieved by LaTeX in typesetting formu- 
lae. From among the plethora of candi- 
dates available in this genre, I want to 
introduce two exceptional examples. 
These are the German language LaTeX- 
Formeleditor [1] and the English Daum 
Equation Editor [2]. 

The LaTeX-Formeleditor is tidy and 
plain, so it loads quickly. Despite the 
German language interface, it is very in- 
tuitive in its operation. Additionally, 
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there is a brief set of instructions avail- 
able as a PDF file. You can enter LaTeX 
code directly into the editor, or you can 
copy it to the editor. In addition, you 
have the option of clicking many formu- 
lae together using buttons for the most 
important mathematical symbols and 
functions. This lets novice users also use 
the program successfully. 

You can download the finished for- 
mula as a PNG file using a link. This file 
will have a resolution ranging from 100 
to 400 dpi. The editor makes the back- 
ground transparent, or it fills it with a 
background color that you have defined 
in the RGB color model. The text color 
cannot be adjusted. Errors that occur 
when LaTeX code is edited get displayed 
by the editor. All of the formulae are 
stored permanently and can be down- 
loaded as needed at any time via the cor- 
responding link. 

The Daum Equation Editor uses Adobe 
Flash and requires the corresponding pl- 
ugin for your web browser. You can 
enter the code either directly or by com- 
bining the numerous templates from the 
large menu of symbols and formula. As 
with the LaTeX formula editor, you don’t 
need LaTeX skills to use the Daum Equa- 
tion Editor. You can save the LaTeX code 
and the finished expression as a PNG 
file. The program lets you select colors 
without restrictions for the text and the 
background from the RGB color model. 

Admittedly, the Daum Equation Editor 
can only generate pure formulae. It will 
purposefully ignore LaTeX commands, 


LISTING 1: SAMPLE LATEX FILE 


01 \documentclass{scrartc!} 

02 \usepackage[utf8]{inputenc} 

03 \usepackage[T1]{fontenc} 

04 \usepackagefenglish]{babel) 

05 \usepackage(graphicx) 

06 \title(Hetio World) 

07 \author{Paul Penguin) 

08 \datel} 

09 \begin{document} 

10 \maketitle 

11 \tableofcontents 

12 \section{Hello Text World!) 

13 This is a new sample text. 

14 \section(Hello Math World!) 

15 This is a new sample formula:\\ 

16 $ F(n) = \frac((\varphi)*n - (-\fracti){\ 
varphi})An)(\sqrt{5}} $ 

17 \section{Hello Picture World!) 

18 This is a new sample picture:\\ 

19 \includegraphics{pic.png} 

20 \end{document) 


O TexeR-Artof Probl... * 
| € © sor etofprobiemsolvng conve" 


| APS 


Online School, 


1 \documentctass{scrartel} 
\usepackage ut 8} ({nputenc} 
\usepackage|T1} (fontenc) 
å \usepackage|english] {babet} 
5 S\usepackage(graphicx) 
| © \title(Hetto Wortd 
| ? \outhor’Paut Penguin} 
3 \date{) 
) \begin (document) 
19 \naketitle 
\tableofcontents 
\section(Hetlo Text World!) 
13 This is a new sample text. 
14 \section(Hello Hath World! 
15 This is a new sample formula:\\ 
5 $ Fin) = \frac((\Warphi}*n - (-\frac(1)(\Warpht) )*n}(\sqrt(5)} $ 
S\section{Hello Picture World!) 
SThis ts a new sample picture:\\ 
| 19 S\dncLudegraphics{pic. png} 
0 \end (docunent} 


such as \text{} for inserting text in a for- 
mula. It will typeset this text instead as a 
succession of variables in italics and 
without blank spaces. 


ONLINE EDITORS 

Online LaTeX editors are web-based and 
simulate a full-fledged LaTeX editor. You 
type or copy your LaTeX code into the 
editor window and receive the finished 
document for downloading. These kind 
of online LaTeX editors are especially 
suitable for users who only occasionally 
use LaTeX to create simple documents 
and don’t want to go to the effort of in- 
stalling a complete LaTeX system on 
their computer. Regular LaTeX users can 
also profit from these online editors, 
since they can also work on a computer 
that is not equipped with the system and 
still use simple LaTeX documents. The 
most interesting specimen in this genre 
is TeXeR [3]. 

Other LaTeX services incorporate an 
online LaTeX editor into a complete plat- 
form that also makes templates and on- 
line storage space available. Ideally, this 
kind of package will let you share docu- 
ments stored online for editing by other 
users. This makes it potentially possible 
for any member of a work group to work 
on a project. Examples in this category 
of editors include TeXonWeb [4], 
ShareLaTeX [5], and Overleaf [6]. 


TEXER 
The simple online LaTeX editor TeXeR 
offers a window with two panels. The 
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Figure 1: The simple online LaTeX editor TeXeR does not incorporate data that is stored locally, nor 
does it generate a table of contents. 
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PostScript 


|\section{Hello Text world!) 


is is a new sample text. 


|\section{Hello Math World!} 


is a new sample formula: 
CARE oy 


Æ 37,6K8 3 28,5MB Œ Q texonweb 


AN 
{iasi \warghid Vodt\sqrt{S}} $ 


PDF | Logfile 


| Select format, number of passes: 
latex v | 2passes v | “| Compress output? 


Figure 2: TeXonWeb's editor window with expanded functions for users who are logged in. After registering, it is also possible to upload and incorpo- 
rate images. 
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editor sits in one of the panels and the 
preview in the other. This editor cannot 
open locally saved files. You will need to 
type or copy the LaTeX code into the edi- 
tor panel. The finished LaTeX document 
is downloaded in PDF format. If an error 
occurs when LaTeX runs, you should 
take a closer look at the logfile for the 
LaTeX output and the error message. 

Figure 1 shows TeXeR with the mini- 
mal example from Listing 1. Lines 5 and 
17 to 19 have been commented out since 
TeXeR cannot incorporate images that 
have been stored locally. It takes two 
LaTeX runs to generate a table of con- 
tents for LaTeX documents. This does 
not work with TeXeR. In light of these 
restrictions, TeXeR is primarily suitable 
for the occasional user who does not 
want to install a LaTeX system locally 
but nonetheless wants the option of gen- 
erating simple LaTeX documents. 


TeXonWeB 

The Czech website TeXonWeb is also 
available in English. Although according 
to the developers, they are still fine tun- 
ing the corresponding localization. If 
you do not establish a user account, you 


will only have access to a simple LaTeX 
editor for entering LaTeX code by typing 
or copying. 

You have the choice of generating the 
output file with either TeX or LaTeX. You 
can also select either one, two, or three 
program runs so that the program out- 
puts documents like a table of contents 
correctly. The generated document can 
be downloaded as a Postscript or PDF 
file. There is a logfile for help with find- 
ing errors in the LaTeX code. It is not 
possible to incorporate locally stored im- 
ages unless you have a user account. 

Additional functions are made avail- 
able to users with a user account. Pro- 
viding a username and a password suf- 
fices to set up the account. TeXonWeb 
does not ask for an email address or per- 
sonal data. Once logged into your ac- 
count, you can open and edit locally 
saved files. In addition, the LaTeX files 
plus the images they incorporate can be 
stored on the TeXonWeb server. 
However,the website lacks a data pri- 
vacy statement. Consequently, you 
should think carefully about what you 
want to upload to the server. 

A menu and a function bar will appear 
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\docunentelass(screctel} 
\usepackagel urfel inputencd 
\usepackagel Ti]{fontenc} 
\usepackagel english] {babel} 
\usepackage(qraphicx} 
\title(Hello World} 


\author {Paul Penguin} 
\datet) 

\begin{docunent) 

\naketitle 

\tableofcontents 
\section(Hello Text World!) 
This is a new sanple text. 
\section{Hello Math World!) 
This is a new sanple fornula:\\ 
$ F(n) = \Frac((\varphiy’n - (-\frac{4}{\varphi})*n}{\sart(s}} $ 


~ \section{Hello Picture World!) 


This is a new sanple picture:\\ 
\includegraphics{pic.png) 
\end{docunent)) 
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in the editor. Both offer the possibility of 
adding LaTeX commands, a feature that 
is similar to locally installed versions of 
a LaTeX editor. There is also a spell- 
checker. Next to this is a very small se- 
lection of templates available for your 
use. These include a CD cover, a DVD 
cover, and a resume along with the cur- 
riculumvitae package. TeXonWeb does 
not offer the option of sharing data with 
other users. Figure 2 shows TeXonWeb 
with a minimal example from Listing 1. 


All in all, TeXonWeb has a rudimen- 
tary feel, but it is entirely suitable for in- 
dividual users who don’t want to install 
a local LaTeX system. This service is free 
to use and does not require personal 
data for setting up an account. On the 
other hand, it does not permit collabora- 
tive work, nor does it provide a data pri- 
vacy statement for data that is stored on 
its server. 


SHARELATEX 

The ShareLaTeX platform always re- 
quires that you register, and it comes 
with various pricing models. The free-of- 
charge version does not allow for collab- 


orative project work with other regis- 
tered users. The collaboration feature is 
part of the pay-to-play versions. These 
versions also maintain a document his- 
tory for restoring earlier versions of a 
document, and they permit you to incor- 
porate various online data storage ser- 
vices. 

After registering and logging in, you 
can set up your first project. This can be 
done with an empty project, you can up- 
load locally saved files, or if you are 
working with a paid version of the plat- 
form, also files from an online storage 
location. There are, in addition, a multi- 
tude of templates from which you can 
select a project. Figure 3 shows ShareLa- 
TeX with the example from Listing 1. 

The templates are primarily oriented 
to the needs of students and university 
faculty. Among other things, they in- 
clude templates for bibliographies, 
books, theses, presentations, letters, re- 
sumes, business cards, class schedules, 
and barcodes. Many of the templates ob- 
serve style guidelines for various col- 
leges. 

At its most basic, a project consists of 
a single LaTeX file. It can also contain 
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Figure 3: The functions offered by the ShareLaTeX platform extend far beyond the requirements of a minimal example. This platform can even be used 
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1 \documentclass{scrartcl} 


# 454KB435,7MB C 


\usepackage[utfa] {inputenc} 


\usepackage(T1I{ 


4 \usepackagelengl 
\usepackage(graphicx) 
\title(Hello World) 

7 \author{Paul Penguin} 


\date{) 
\begin{document} 
\maketitle 


1 \tableofcontents 

2 \section{Hello Text World!} 

This is a new sample text. 

\section{Hello Math World!) 

5 This is a new sample formula: \\ 

6 $ Fin) = \fract( 
\section{Hello Picture World!) 
This is a new sample picture:\\ 
\includegraphics{pic.png} 


\end{docunent}; 


ect data between the server and local computer. 
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fontenc} 
ish} {babel} 


\varphi)^n - (-\frac{1}{\varphi})°n}{\sqrt{5}} $ 


Figure 4: Already in its free-use version, Overleaf makes it possible to collaboratively work on LaTeX documents and also use Git to synchronize proj- 


multiple files and perhaps even images. 
There is a function for you to set up sub- 
folders in a project where you can put 
things like images you have collected for 
storage. 

The online editor ShareLaTexX offers a 
large variety of functions. One example 
would be tallying the word count for a 
project, something that is important in 
the university setting where there is 
often a minimum and maximum word 
count prescribed for an assignment. A 
spellcheck for various languages is also 
available. The autocomplete function 
simplifies use of the LaTeX commands. It 
would be great if there were a functions 
list that let you instantly add commands 
and LaTeX environments from the list. 

The choices for generating a PDF file 
from your project include LaTeX, PDFLa- 
TeX, XeLaTeX, and LuaLaTeX. ShareLa- 
TeX also generates logfiles, which makes 
a search for errors easier. You can display 
the PDF file that has been generated with 
either the integrated viewer or with a lo- 
cally installed PDF viewer. All of the doc- 
uments that have been generated, as well 
as all of the project files, can be down- 
loaded, so they can be archived locally. 


Q, overleaf 


>see tro PF =) 


The fee-based versions let you share 
projects with other registered users. You 
can decide whether these other users 
have read and write permissions. The 
documentation includes an introduction 
to LaTeX that is helpful for newbies and 
also a description of working with 
ShareLaTeX. 

In general, ShareLaTeX makes a solid 
impression. Due to the template offer- 
ing, it is especially well suited for aca- 
demic clientele. It is too bad that collab- 
orative work on projects is only available 
in the fee-based versions. 


OVERLEAF 

Like ShareLaTeX, Overleaf is also defi- 
nitely better if you register. There are 
three price models to choose from. The 
free-to-use version limits the amount of 
online storage and the number of files 
per project, but it does support sharing 
projects with other users who can have 
read and write permissions. The fee- 
based versions let you integrate Drop- 
box, provide a document history for re- 
storing earlier versions of documents, 
and let you secure a project. The plat- 
form offers student discounts. 
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As soon as you have registered and 
logged in, you can set up your first proj- 
ect. Depending on what you want, you 
can start with an empty project, upload 
locally stored files, or select from the 
large variety of templates. These include 
templates for articles, bibliographies, 
theses, books, presentations, calendars, 
resumes, and letters. Overleaf cooperates 
with the LaTeX Templates website [7], so 
you can open templates you find there 
directly in Overleaf. 

A project consists of one or multiple 
LaTeX files and can also include images. 
subfolders inside of a project make file 
organization easier. The LaTeX editor in- 
tegrates a preview, which displays 
changes to the LaTeX file in the com- 
pleted document immediately (Figure 4). 
If you want to generate a PDF document 
from the project code, you can select 
from among LaTeX, PDFLaTeX, XeLaTeX, 
and LuaLaTeX. It is possible to down- 
load the generated PDF file, as well as 
the entire project. 

The fontspec [8] package lets you use 
several different fonts. Some well-known 
fonts are already available in Overleaf. 
You can upload your own from you com- 
puter. Comments are created in LaTeX 
files with the LaTeX command % or al- 
ternatively using a separate function in 
the editor that lets other users answer 
your comments. 

The editor shows error messages as 
LaTeX runs. You can use the logfile to 
find the causes. An icon bar contains 
functions for use with editing and 
searches, as well as a small selection of 
LaTeX commands that you can insert 
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with a press of the button. The autocom- 
plete in LaTeX code makes it easier to 
use the commands. There is also a spell- 
checker for various languages. 

Overleaf permits collaborative work 
even in the free-to-use version. Here the 
platform assigns three links to each 
project. One of these allows access for 
editing; the second contains a read per- 
mission. The third is a Git link via 
which you have the option of download- 
ing project data from Overleaf as desired 
or synchronizing local changes to the 
project with the server(see the “Syn- 
chronizing Files with Git” box). The dis- 
advantage is that anybody who knows 
the link has access to the project. Se- 
cured projects are those without links 
and are only available in the fee-based 
versions. 


CONCLUSION 

Both the occasional LaTeX user and the 
LaTeX professional will find what they 
need among the various online LaTeX ed- 
itors that are available. The user who 
normally generates documents with an 
Office program does not need to forego 
the advantages offered by the formula set 
from LaTeX thanks to the existence of on- 
line formula editors. The user who 
doesn’t have a LaTeX installation can still 
edit simple LaTeX documents using an 
online LaTeX editor. The user who regu- 
larly works with LaTeX can enjoy plat- 
forms that offer a multitude of templates, 
as well as integrated online storage 
space. This lets these users access their 
work at all times from anywhere. It also 
makes collaborative work possible. e 


A Git link that is assigned to every Overleaf project allows the project to use Git [9] 
to synchronize between the server and a local computer. This makes it possible to 
also work on a project offline. 

To synchronize, you should create or open a project and click in the header bar on 
the Share button. A dialog will appear where you will find the Git link for your proj- 
ect under the Clone With Git option. Now you should set up a local directory for the 
project using the mkdir from the command line and download the project from the 
server to this directory using: 

git clone Git-Link 

After making changes locally to the files, prepare them for the transfer to the server 
by using: 

git commit -am change” 

Then you upload them with git push. If you have set up a new file locally that does 
not yet exist on the server, you can add it with git add <file>. Changes to the files on 
the server are downloaded to the local directory with git pull. Instead of using the 
command-line command, you can also use a graphical user interface for Git [10]. 
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INFO 


[1] LaTeX-Formeleditor: http://www. 
zahlen-kern.de/editor/index.php 

[2] Daum Equation Editor: http:/ 
www.matheretter.de/tools/ 
formeleditor/ 

[3] TeXeR: http:/ 
artofproblemsolving.com/texer/ 

[4] TeXonWeb: hitp://tex.mendelu.cz/ 
en/ 

[5] ShareLaTeX: http://www. 
sharelatex.com 

[6] Overleaf: http:/www.overleaf. 
com 

[7] LaTeX Templates: http://www. 
latextemplates.com 

[8] fontspec LaTeX package: hitp:// 
www.ctan.org/pkg/fontspec 

[9] Git: http:/git-sem.com 

[10] Git GUIs: https:/git-scm.com/ 
download/gui/linux 
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Flash chips are now used as storage devices for operating systems. MultiSystem lets you pack as 
many operating systems as you want on a USB stick. 


Installing multiple operating systems on a USB storage device 


TASTY VARIETY 


BY ERIK BARWALDT 


SB sticks with 64GB and even 
128GB capacity have become 
very affordable. Their large 
storage capacity makes it pos- 
sible to simultaneously use multiple 
operating systems that sit on a single 
stick. It doesn’t matter whether you 
need several specialized live systems 
for administration on the Internet or 
whether you want to access the Inter- 
net anonymously. With the help of 
MultiSystem, the desired oper- 
ating systems 
are au- 
tomati- 
cally 
loaded 
ona 
USB 
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stick together with a bootloader that 
also gets correctly configured without 
the need for any further effort on your 
part. 


PREPARATIONS 
MultiSystem software is distributed 
under the GPLv3 and has undergone 
continuous development for some 
years. It is available as an ISO image 
based on Ubuntu [1] for downloading 
from SourceForge. There are also a va- 
riety of versions to choose from. In ad- 
dition to a number of older versions, 
there are two 1.3GB ISO images for 32- 
bit and 64-bit systems. These are 
based on Ubuntu LTS 16.04 (Xenial 
Xerus). The source code is available 
on the project page - which, be 
warned, is entirely in French [2]. You 
can also find the software in some of 
the repositories for Debian and 
Ubuntu plus their derivatives. You can 
integrate these software archives in 
your system and then install the 
program (see the Adding Mul- 
,tiSystem Repositories box). 
Since some dependencies 
exist but relevant directions are 
partly only in French, it is a good 
idea to use the ISO image that 
comes with a completely precon- 
figured environment. You will have 
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to burn this to an optical data storage 
device (i.e., a DVD). The ISO image is 
not constructed as a hybrid. Therefore, 
it is not possible to use the software 
on a USB memory stick. 

In addition to putting the software 
onto a data storage device and install- 
ing it on an existing Linux operating 
system, you will need to check out 
your chosen USB stick for storing the 
various operating systems. The USB 
stick’s device name should not include 
any blank spaces. Otherwise, the soft- 
ware will generate an error message 
and refuse to operate. If you do use a 
memory stick with a name that in- 
cludes blank spaces, then you will 
have to rename it. The easiest way to 
do this is to use the graphical tool 
GParted. After you have selected the 
given stick in its program window, you 
should right-click on the target parti- 
tion and select the entry Label File 
System from the pop-up menu. Then 
you should enter a new name that 
does not include any blank spaces and 
confirm the name by clicking OK. You 
should make sure that the relevant 
data device has been unmounted be- 
fore carrying out this task. Once you 
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Figure 2: MultiSystem in Ubuntu is embedded in a | 
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idev/sdb (28.89GiB) > 


Partition File System Label Size Used Unused Flags | 
ed i 
| /dev/sdb1 Wi fat32 Multisystem 28.89 GiB 6.95 GiB 21.94 GIB | 


Move /dev/sdb1 to the right and shrink it from 28.89 GiB to 28.89 GiB 
Set file system label "Multisystem" on /dev/sdb1 


(2 operations pending _ 


Figure 1: GParted helps you easily rename the target data storage device. 


are finished, the USB stick is ready to 
use (Figure 1). 

When larger memory sticks are in- 
volved, you will also need to make 
sure that they contain just a single 
partition. This is because MultiSystem 
only recognizes and speaks to a stor- 
age device’s first partition. When ad- 
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home/ubuntuuser/ISOs/ubuntu-16.10-desktop-amd64.iso 


mounting read-only 
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Figure 4: An error message indicates that the 
system does not recognize a distribution. 
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Figure 3: Instead of a progress bar, there is a terminal window that displays the individual steps of 


ditional partitions exist on a flash 
stick, then it becomes impossible to 
use all of the capacity. 


GETTING STARTED 

Now you should restart your system 
from the DVD containing the MultiSys- 
tem distribution. A typical Ubuntu 
desktop will open where you will see 
that MultiSystem has already started 
automatically. The system automati- 
cally recognizes the stick here and lists 
it in the program window. If you have 
mounted multiple USB sticks on your 
system, then all of them will be listed, 
and you will be asked to select the stick 
that is intended for use with MultiSys- 
tem. The window will first appear in 
English. You can localize to your lan- 
guage of choice with a single click on 
the button sitting to the right of the flag 
icon at the top right of the window. The 
system will change the language ac- 
cordingly for the user interface (Figure 
2). 

MultiSystem supports a large number 
of Linux derivatives and also many 
other operating systems. These can be 
transferred to the USB stick with a boot- 
loader script that has been adapted to 
each. The list of supported distributions 
can be found on the project website [3]. 
The list also contains some distribu- 
tions that are no longer offered, such as 
the Brazilian Dreamlinux, as well as 
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distributions that are no longer devel- 
oped like the Russian Inquisitor Linux. 
Additional systems that are new and 
have recently been derived from exist- 
ing distributions, for example Kolibri 
Linux, are missing from the list. Conse- 
quently, the collection you see is merely 
a rough overview. 


ON THE STICK 

After selecting the USB memory stick by 
clicking on its name, you should then 
click on the Confirm button in the lower 
right of the windos. First, the bootloader 
GRUB2 is written to the master boot re- 
cord (MBR) on the stick. Next, the mem- 
ory stick’s configuration interface opens 
in the program window. You will see the 
distributions and operating systems that 
are sitting on the stick at the top of the 
window. At the bottom of the window, 
you will see an entry field for loading a 
new ISO image. If you have already 
downloaded ISO images from the Inter- 
net and stored them locally, then all you 
need to do is open a file manager and 
drag the ISO image to the Drag and Drop 
ISO/img entry field in MultiSystem. The 
routine immediately starts the transfer of 
the image to the stick. Another window 
will open that shows the progress for the 
transfer (Figure 3). 

If it turns out that MultiSystem is un- 
able to handle a particular ISO image, 
then it will show an error message, inter- 
rupt the routine, and stop (Figure 4). 
The program then returns to the input 
window. If the ISO image has been suc- 
cessfully transferred, then the operating 
system derivative appears at the top of 
the program window in the form of a 
small icon together with the name. 

This is also where you will be able to 
see the size of the image that is on the 
USB stick, as well as the bootloader that 
is used. You can use this information to 
figure out whether there is enough space 
remaining on the flash stick for addi- 
tional distributions. In the middle part of 
the window, gray-colored text informs 
you how much of the stick’s memory is 
occupied and how much is still available 
(Figure 5). 

If various bootloaders are used, then 
these will automatically be integrated in 
the GRUB2 start menu. This lets you call 
the pertinent operating system without 
any problems when booting the com- 
puter from the stick. 
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In addition, MultiSystem has a func- 
tion designed to let you conveniently 
install the desired operating system on 
the stick. If you have not downloaded 
the necessary ISO images from the In- 
ternet, you can call up a list of sup- 
ported operating systems and distribu- 
tions by clicking once on the Down- 
load Live-CDs: button in the Menu. 
Moreover, you can even filter and dis- 
play these by topic with the Audio, 
Utility, Antivirus, and Gamer buttons. 
Double-clicking on one of the systems 
loads Firefox with the corresponding 
web page, thus saving you from hav- 
ing to find the appropriate source by 
yourself (Figure 6). The Back Home 
button at the lower right takes you 
back to the start window. 


PERSISTENCE 

With live systems, it is usually not 
possible to save the user’s settings and 
personal documents. However, Multi- 
System offers an option by which you 
attach a persistent area. This lets you 
use the live medium like standard bulk 
memory. To do this, go to the main 
window and select the distribution to 
which you want to add a persistent 
memory area. Next select Add persis- 
tent mode from the Menu tab. Then 
you can define the size of the persis- 
tent memory in the subsequent win- 
dow. The changes will be automati- 
cally saved to the bootloader. This 
means that the system will boot with 
persistent memory the next time you 
start it. 

You should be aware that a fair 
number of the distributions listed do 
not support a persistent memory 
mode. MultiSystem will notify you 
with a special window if it is not pos- 
sible to modify the system in this way. 


SAFE IS SAFE 

Setting up a larger flash memory with 
MultiSystem can take a great deal of 
time when the memory contains numer- 
ous operating systems, especially if some 
have been configured with persistent 
memory. The loss of a prepared stick can 
be very annoying. This is likewise the 
case when a defect that causes the loss 
of data. MultiSystem offers a backup and 
restore option for quickly reconstructing 
USB memory. You can find this option in 
the Menu. Clicking on the Backup/Re- 
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Figure 5: You can go to MultiSystem’s home screen at any time to figure out what is on the stick. 


store button opens a window that lets 
you set a radio button for backing up 
and restoring removable media (Figure 
7). 

A backup can run with a file manag- 
er’s help in the directory of your choice. 
Restoring the medium requires that you 
pay attention to the drive. This is be- 
cause multiple removable media may be 
mounted on the system. Errors in assign- 
ing the drive may destroy data since the 
routine overwrites existing files on the 
target storage device. 


Test RUN 
MultiSystem comes with a number of 
routines for testing a newly set-up sys- 
tem’s functionality. As a result, you can 
use them on virtual Linux systems like 
KVM/Qemu or VirtualBox. With many 
distributions, the latter can be conve- 
niently installed from the repositories. In 
order to proceed with testing, you 
should select the Boot tab in the Multi- 
System’s program window. Out of the 
list of options that appears, you should 
choose one of two buttons, either Test 
your liveusb in Qemu or Test your liveusb 
in VirtualBox (Figure 8). Both of these 
options start a ready-to-use, preconfig- 
ured virtual machine, and they open the 
MultiSystem stick in a terminal window. 
Once this occurs, you can start the oper- 
ating system you want to test from the 
GRUB boot manager on the stick. 
Should problems occur, you can test 
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Figure 6: MultiSystem can also download ISO images from the Internet. 


individual ISO images that have been 
used to generate an operating system on 
the MultiSystem stick by selecting the 
Try a LiveCD in VirtualBox option in the 
Boot tab. Then drag and drop the ISO 
image you would like to test from a file 
manager to the entry field for the test 
routine, The image then starts. 


ADAPTABLE 

There are several options you can use to 
customize MultiSystem after installation. 
Go to the program home screen and 
click on the eye icon that sits to the left 
of the distribution list. A multi-column 
area with a variety of buttons will ap- 
pear on the right side of the screen. The 
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Figure 7: You can back up a USB stick or restore 
it with just a few mouse clicks. 


arrow buttons let you move individual 
entries in the GRUB start menu up or 
down so that you can arrange the distri- 
butions in a convenient sequence. In ad- 
dition, the GRUB settings button has a 
number of settings with which you can 
determine how the start menu should 
look. For example, you can change the 
colors for the menu and the background. 

The Add a boot option (cmdline) but- 
ton lets you set customized parameters 
for each start entry. A special window 
will appear once you choose this button. 
It contains several options for the trans- 
fer to the boot process already displayed. 
An option becomes active once it is 
checked. The entry field you see will 
also let you configure start parameters to 
the system for specialized hardware that 
you would prefer to use with the Multi- 
System stick (Figure 9). 


About 
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Figure 8: The Boot menu hasa start option. i 
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START SUPPORT 


When using the MultiSystem stick on 
older computer systems, you run the risk 
that the computer and stick cannot talk 
to one another. Older computers do not 
have sufficient capabilities for starting 
from USB media. If this is the case, it can 
help to generate a boot CD that then 
talks to the USB. The PLop boot manager 
is suitable for this task. This manager is 
available for download in the Non-free 
tab in the MultiSystem program window. 

Switch to the Boot tab and click on the 
button Create a CD to start USB. The 
software will now generate a small ISO 
image, which you should burn to a 
blank CD. Then you should insert the 
MultiSystem flash stick into one of the 
USB ports on the target computer and 
put the CD into the optical drive. The 
computer will start the CD. The PLop 
boot manager that the CD loads provides 
the computer with access to the Multi- 
System stick and lets it boot the desired 
distribution. 


ADDITIONAL Uses 

The Menus tab contains some additional 
buttons in the right column. These make 
using MultiSystem easier. For example 
you can open a terminal in order to 
quickly execute commands on the com- 
mand line without having to trouble 
your distribution’s menu structure. The 
Format your USB key deletes data from a 
memory stick that you have used previ- 
ously and automatically sets up a single 
partition. This is particularly useful 
when you use larger memory sticks that 


ADDING MULTISYSTEM REPOSITORIES 


have multiple partitions. Since MultiSys- 
tem only recognizes the first partition on 
a data storage device, it is absolutely 
necessary that all other partitions be de- 
leted so that the entire stick is available 
for use with the tool. The Install Virtual- 
Box option lets you download the virtual 
environment VirtualBox directly from 
Oracle, its manufacturer, and put it on 
your bulk memory. This is helpful when 
you can’t find this program in your 
Linux distribution’s repositories. 


CoNcLUsION 

MultiSystem finally makes mobile use of 
various operating systems possible with- 
out time consuming installation on inter- 
nal bulk storage. However, the software 
still has a few defects. The program is 
fixated on Ubuntu and Debian. There- 
fore, users of other Linux derivatives will 
need to put the complete Ubuntu system 
on an optical data storage device in 
order to use MultiSystem. This process is 
inconvenient and takes more time than 
when you are dealing with software that 
has been integrated into an installed op- 
erating system. The list of supported dis- 
tributions also needs some reworking. It 
contains distributions that have not been 
available for a long time. Other available 
distributions are not included on the list 
or some that do appear are no longer 
supported. It would also be a good idea 
if the French language project website 
were also available in other languages. 
Many users shy away from using what is 
a very useful tool because they do not 
want to have to deal with French. e 


MultiSystem can also be installed from your own repository. Debian and its deriva- 
tives, plus Ubuntu and its variations like Linux Mint, receive support here. If you 
switch to a terminal for integrating the repository on your system, you should exe- 
cute the command: 
sudo apt-add-repository 2 

„deb http;//liveusb.info/2 

multisystem/depot al) main’ 
Then you should import the accompanying public key with: 
wget -q -0 - http://liveusb. info2 

/multisystem/depot/multisystem.asc | 2 

sudo apt-key add - 
The next step is to update the package list with: 
sudo apt-get update 
Now you can install the software with: 
sudo apt-get install multisystem 
This procedure is suitable for Ubuntu and its derivatives and also for all of the dis- 
tributions that are directly related. 
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ify the GRUB boot manager for the loading of 
the operating system. 


INFO 


[1] Download MultiSystem: https:/ 
sourceforge.net/projects/ 
multisystem/files/iso/ 

[2] MultiSystem project page: http:/ 
liveusb.info/dotclear/index.php? 
pages/install 

[3] Supported distributions: http:// 
liveusb.info/dotclear/index.php? 
pages/os 
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The latest offering from PlanetWatt, this lightweight distribution is specifically geared towards 
energy efficiency, giving older machines a new lease on life. 


Turbo-charged machines with wattOS 


Whar OS 
BUT WATTOS? 


BY NATE DRAKE 
lanetWatt unveiled wattOS R10 in Despite the emphasis on energy-effi- 
September 2016, which is based ciency, this isn’t apparent from the boot 
on Ubuntu 16.04.1 LTS for long- menu or the rather leafy desktop, which 
term support and stability [1]. is at once very easy on the eye, but con- 
Since a tentative beta was released in tains minimal clutter. By default only 
July 2013 [2], releases have been on three apps are displayed. Besides the ha- 
roughly an annual bitual trash can, the default desktop con- 


basis. tains shortcuts to the Firefox v48.0 web 
browser and the Lollypop v0.9.112 music 
player (Figure 1). 

WattOS’ spartan LXDE desktop envi- 
ronment is coupled with the lightweight 
i3 window manager. PlanetWatt, the 
project developers’ website, claims that 
any system that has a processor re- 
leased in the last 10 years is com- 
patible with the operating system 
(OS). WattOS requires 192- 
256MB of RAM for installation, 

but the website claims that less 
than 128MB are required once 
the install is complete. When 
testing in VirtualBox, I found 
that 256MB of RAM and 35MB 
of video memory was more 
than enough to keep wattOS 
ticking over nicely. 


KILOWATTS 


Try Berore You Buy 
If the lure of a lightweight distro 
appeals, 32- and 64-bit versions of 
wattOS are available from the devel- 
oper’s site via BitTorrent or direct down- 
load [3]. Both versions can fit fairly com- 
fortably on a single CD-ROM. 
Like most Ubuntu-based distros, the 
CD-ROM can be used in live mode for 
testing purposes, subject to the usual 


Viktor Gmyria, 123RF.com 
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proviso that any changes you make or 
files you save will be lost on reboot. The 
installer is identical to Ubuntu’s. For the 
security conscious, full disk encryption 
is supported, as is home folder encryp- 
tion. WattOS comes with powertop prein- 
stalled, so it can be installed alongside 
other OSs, such as Microsoft Windows. 

The installer also contains the only 
bug I could find in wattOS: When enter- 
ing your name, the username field re- 
mains as guest rather than suggesting 
your forename automatically. This can 
be updated manually, but it could be a 
nuisance for less experienced users who 
may inadvertently hitch themselves with 
an unwanted username. 


Watt Apps 

Once installation is complete, take time 
to enjoy the crisp greenery of the desk- 
top background and then click on the 
Applications menu to explore the default 
programs. 

Time and care have been put into pro- 
viding a minimal set of useful applica- 
tions that will not overburden the sys- 
tem. WattOS R10 has switched to using 
the Lollypop to give users access to a 
wide variety of music stations, saving 
the trouble of downloading music. 

KeePassX 2.0.2 has been included for 
password management. Firefox is ac- 
companied by Filezilla 3.15.0.2, as well 
as the Transmission BitTorrent client. 

The most recent iteration of wattOS 
also now includes gThumb 3.4.3 as the 
default image editor (Figure 2). 

WattOS’ focus on efficiency makes it 
an attractive prospect for laptop users. 
To this end, the System Tools section 
now contains Laptop Mode Configura- 
tion. While not as beautifully laid out as 
the rest of the system, this utility allows 
you to enable or disable a number of en- 
ergy saving features. Some of these are 
already activated, such as auto-hibernate 
and Intel’s Powersave mode. Others such 
as Bluetooth are disabled by default until 
needed. 

Click Preferences > Firewall Configu- 
ration to open Gufw, the handy graphi- 
cal front end to Uncomplicated Firewall 
(UFW). Aside from saving the trouble of 
entering firewall rules via the command 
line, Gufw has many preconfigured set- 
tings to allow connections by popular 
programs, saving you the trouble of re- 
membering individual port numbers. 


Figure 1: The default wattOS desktop using LXDE. Desktop shortcuts have been placed for more 


common apps, such as Firefox and Lollypop. 


Under the hood, WattOS R10 has 
added Dynamic Kernel Module Support 
(DKMS) and legacy broadcom support, 
meaning more wireless cards and other 
hardware should be supported out of the 
box. Purists will be pleased to know R10 
uses version 4.4.0-38 of the Linux kernel 
[4]. 


WATT OMISSIONS 

Having discussed the careful selection of 
apps in wattOS R10, it’s wise to focus 
also on those that have been removed 
since the last version. 

R10 uses the ultra-zippy i3 as the de- 
fault window manager as opposed to 
Openbox, which came bundled with 
wattOS R9. Samba appears to have been 
removed. The Midori web browser and 
Audacious music player have been re- 
placed with Firefox and Lollypop respec- 
tively. 

Lollypop will happily play music files 
such as MP3s out of the box, but other 
media files such as MP4 video have no 
associated app. The installer has the op- 
tion to download some third-party co- 
decs during setup, although this may 
cause issues (see below). 

Applications > Office contains only 
the Evince document viewer, which can 
display PDFs. Use LXTerminal or the pre- 
installed Synaptic package manager to 
install additional software, such as VLC 
media player and LibreOffice. 
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Figure 2: Use gThumb to edit your favorite cat pictures. Launch from Applications > Graphics. 
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On the plus side, the size of the wat- 
tOS R10 ISO is now well below 700MB 
allowing it to be easily burned onto a 
CD-ROM, whereas the previous version 
was 711MB, which required users to em- 
ploy overburn or use a USB stick. 


Microwatt 

How do you improve on an OS that has 
already been stripped down to its bare 
bones for sheer efficiency? The answer 
naturally is to create an even more 
stripped down version of that same OS. 

PlanetWatt released Microwatt R10 on 
September 23, 2016, shortly after the re- 
lease of WattOS R10 itself. Microwatt is 
also based on Ubuntu 16.04 LTS, and its 
core system is based on version 4.4.0-38 
of the Linux kernel. 

The stable version (4.11) of the i3 til- 
ing window manager has also been pre- 
installed to offer a lighter memory foot- 
print than wattOS’ LXDE version. The 
PlanetWatt team claim this results in an 
improvement of 20-40% on average [4]. 

Microwatt comes with virtually no 
preinstalled apps. Surf v0.7 is available 
for basic web browsing. The minimalis- 
tic MuPDF version 1.7a-1 is also pre- 
loaded for viewing PDF documents. 
Aside from the PCManFM file manager 
(Figure 3), there are few other utilities. 

Fortunately one of the few utilities that 
does come preloaded is Synaptic, allow- 
ing you to install extra applications. The 
desktop also lists hot keys to launch the 


terminal, file manager, and web browser 
respectively by using the Windows key 
and a combination of letters. Mac users 
can rest assured that the Command key 
works just as well. 

As there is no desktop environment 
per se, navigating windows can be 
tricky. As such, it’s best to use the termi- 
nal app to launch and kill processes as 
you need them. Alternatively you can in- 
stall a new desktop environment. 

It’s no surprise then that PlanetWatt refer 
to Microwatt as a “do what you want” re- 
lease. The OS allows you to browse through 
the various software available before decid- 
ing on your program of choice. Needless to 
say, Microwatt also incorporates the power 
management utilities of wattOS to optimize 
it for laptops. This is helped in no small 
part by the battery, RAM, swap, and CPU 
usage stats, which are permanently dis- 
played at the bottom of the screen. 

Just like wattOS, the ISO for Microwatt 
R10 can be downloaded directly or via 
BitTorrent, but it is a mere 627MB mean- 
ing it will fit onto all CD-ROMs. 


PLANETWATT 

The wattOS developers’ website, Planet- 
Watt, seems to echo the bare-bones feel 
of both wattOS and Microwatt. In the 
first instance, entering http://www. 
planetwatt.com into your browser will 
result in an admonition to go to the 
“new” website, which appends /new to 
the original URL. 

PlanetWatt does contain links to a 
Wiki for both wattOS R10 and Microwatt 
R10, but at the time of writing, these 
were just landing pages. Fortunately the 
website has very active forums including 
threads dedicated to announcing the re- 
lease of R10 for each OS [5], as well as a 
Rocket.Chat chat room with a dedicated 
channel for the latest version [6]. 

The website claims that confused 
users can message wattOS’ main devel- 
oper Biff Baxter. Whether or not this is 
his real name or if he is paying homage 
to Jeff Daniels’ character in the 1987 
comedy Radio Days, Biff plays an active 
role in both the forum and chat rooms 
and responds promptly to questions 
about usage and release dates of new 
versions of wattOS and Microwatt. 


Watt A Mess 
Users who try to test drive wattOS in 
VirtualBox may find that they see myste- 
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rious colors on screen and their device 
fails to load at all. You may be able to fix 
this by increasing the available video 
memory to the virtual machine. Failing 
this, go to Settings > System and check 
the box marked Enable EFI (Special OSs 
only). These settings will only apply to 
the wattOS virtual machine, so do not 
worry about this interfering with the op- 
eration of others. 

Similarly Microwatt can experience 
kernel panic in a virtual machine if 
started with too little video memory. 1 
found that allocating at least 24MB video 
memory in the Display tab and enabling 
3D acceleration allowed Microwatt to 
load normally. 

Although wattOS can technically in- 
stall software capable of playing high- 
definition videos or processing large 
amounts of data, it will still be con- 
strained by the hardware specs of your 
system, so do not expect to turn a 
10-year-old PC into a high-end gaming 
server simply because it has an efficient 
OS installed. 

Users in need of technical support 
can head to the PlanetWatt forums. 
According to the official thread an- 
nouncing the release of R10, current 
known issues include the installer 
crashing when choosing to download 
third-party codecs to play media, as 
well as both encrypting the system 
and home folder. In the meantime, the 
forum admins suggest choosing only 
one type of encryption and download- 
ing the necessary third-party codecs 
post-install. 


Watt Am |? 

Out of the box, there is very little that 
wattOS or its smaller Microwatt compan- 
ion can do. As a user, it is down to you 
to decide which applications to add, 
which will commence on startup, and 
how your power-saver settings will be 
managed. Advanced power users may be 
delighted about this given that they can 
finally customize their Linux OS accord- 
ing to their whims. 

Newcomers to Linux may find this dis- 
tribution is not to their taste unless they 
are willing to become very well ac- 
quainted with the Synaptic package 
manager and/or the command line. In 
particular, navigating the i3 window 
manager in Microwatt can be tricky for 
those who are not Linux veterans. Cer- 
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Figure 3: PCManFM as it appears in Microwatt R10. i3 displays system information at the bottom 


of the screen but windows cannot be minimized here. 


tain applications do not play well to- 
gether, so it may take some time before 
you can shape a system entirely to your 
taste. 

Remember that both wattOS and Mi- 
croWatt support Ubuntu’s “live” mode, 
to allow you to test run your configura- 
tion of choice. If you do try to install 
extra programs, however, bear in mind 
the CD-ROM will load into your RAM 
memory, so you'll be limited by the 
available space there. Performance will 
also not be as fast as when the OS is in- 
stalled to your hard drive. 

Overall, WattOS is by no means the 
only lightweight Ubuntu-based distro 
out there. However, the small ISOs, fast 
loading times, and high degree of cus- 
tomization make it a strong contender. 
The thought of dusting off the old PC in 
the attic and giving it a new lease on life 
is also very exciting. PlanetWatt main- 
tains that wattOS will run on machines 
up to 10 years old. Should you decided 
to experiment with the OS on an old 
and/or low-spec PC, make sure to post 
in the wattOS forums with details of 
your configuration. e 


INFO 


[1] WattOS R10: http:/planetwatt.com/new/index.php/2016/09/01/ 
wattos-r10-released/ 


[2] DistroWatch: https:/distrowatch.com/table.php?distribution=wattos 
[3] Download wattOS Linux: http:/planetwatt.com/new/index.php/downloads/ 


[4] Microwatt R10: http:/planetwatt.com/new/index.php/2016/09/23/ 
microwatt-r10-released/ 


[5] WattOS R10 forums: http:/planetwatt.com/newforum/index. php?board=14.0 
[6] WattOS R10 Rocket.Chat: https:/wattos.rocket.chat/channel/wattos-r10 
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o DESKTOP Focus STACKING — 


In macro photography, multiple images are merged together in order to generate a 
single picture. Under Linux, the enfuse tool performs this task. An alternative approach 
is to use GIMP which lets you merge images manually, an approach that brings with it 
additional possibilities. 


Macro photography under Linux 


SHARP CONTRAST 


BY KARSTEN GÜNTHER 


Stanislav Bokser,123RF 


acro photography is fascinating 
for many. This form of photog- 
raphy often presents details that 
would otherwise be overlooked, 
because it is able to put them into proper 
focus. However, it is impossible to make a 
sharp macro photo of an entire object be- 
cause not all of its depth of field can be in 
focus at once. This is mostly due to restric- 
tions imposed by the optical properties inher- 
ent in the combination of camera and lens. 
The larger the sensor and the focal distance, 
the smaller the depth of field will appear. Be- 
yond a certain point, an open aperture will 
only capture a sharp region that is just a few 
millimeters in size. As an aside, these optical 
properties also explain why small compact 
cameras with small sensors and lenses fre- 


quently do a surprisingly good job of making 

photographs with a large depth of field. Even 

so, the quality of the sensors and lenses in 
these cameras is normally not as good as it is 
in larger cameras. 

Strong stopping down improves depth of 
field (see the “Stopping Down” box). How- 
ever, this approach only works for smaller re- 
gions of an image. Contemporary lenses have 
a maximum aperture size of 22. The f-num- 
ber is equal to the ratio of the focal length to 
the entrance pupil. It used to be that lenses 
had larger f-numbers. This quickly led to flex- 
ion and in turn, to blurring. As a result, stop- 
ping down may not be a good solution. Prob- 
lems that occur with this approach include: 

e The sharpness is limited to a relatively nar- 
row region even with a large stop down. 

© The prolonged exposure times mean that 
even slow moving objects are often impos- 
sible to photograph. 

e Sharpness is not optimal with a small aper- 
ture opening, and it is often not possible to 
manually adjust for optimization. 

Photographers have long been thinking about 

resolving the depth of field issues by combin- 

ing multiple images with different focus 
points. This technique involves using sharp 
regions of images that are extracted from mul- 
tiple, nearly identical images, all taken from 
the same angle with the most similar lighting 
possible in order to replace and cover regions 
that are out of focus. This approach assumes 
that you have the necessary images and that 
you also have the means for cutting small 
parts out of the images. Gimp’s mask technol- 
ogy provides the tool you need for performing 
this type of digital image processing. The term 

“mask” refers to an image’s regions that are 

isplayed or hidden on a layer depending on 

the color used by the mask. The color white 
on a layer mask causes the mask to display 
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the contents. Black makes them invisible. All 
of the regions from the various images will 
have to be put together as layers in order to 
generate a single image that is sharp through 
and through. 

Modern RAW converters can help to detect 
the sharp regions of an image in digital nega- 
tives. Programs like darktable and RawThera- 
pee have indicators for marking the regions 
that are in focus (Figure 1). 


CREATING IMAGES 

There are some things to watch out for when 
making the images to ensure that you get 
good results. For one, you definitely will need 
a tripod when using focus stacking. The algo- 
rithms in the program are not good enough to 
make larger variations among the image parts 
invisible. Artifacts will remain behind and 
mar the results. 

Many focus stacking images are generated 
in studios and laboratories (see the “Focus 
Stacking and Microscopy” box). This is be- 
cause it is possible to impose controls over the 
conditions of these environments. Even the 
smallest movement of air can have an impact 
on an extremely lightweight object. Likewise 
issues can arise with changes in lighting. Con- 
sequently, a tripod proves itself very helpful 
for both camera and light sources. Therefore, 
it makes sense to place both camera and light 
sources on tripods and then make sure they 
don’t interfere with each other. Camera man- 
ufacturers recommend that you switch off the 
image stabilizer for the camera when using a 
tripod. 

You should use a monochromatic black 
background in order to achieve good contours 
and contrasts. You should not point the light- 
ing directly at the background. A side light 
avoids hard shadows and garish colors; it also 
helps emphasize the three dimensional qual- 
ity of an object. Moreover, it is a very good 
idea to set the exposure compensation for the 
aperture on at least minus one. This will 
darken the background accordingly without 
making the object itself dark. 

Anumber of different factors influence the 
sharpness or depth of field. In order to gener- 
ate suitable images, you should become fa- 
miliar with the following: 

e Distance between lens and object 

¢ Focal length 

© Sensor size 

e F-number 

e ISO value 

Currently, there are at least three methods for 
creating images for use with the focus stack- 
ing technique: 


= = ng 


Figure 1: RawTherapee has a function that shows where an image's sharp regions can be found in 


a digital negative. Activate this function using the button shown by the yellow arrow. 


e Manual focus: Focus on the closest part of 
the object, make an image, and then focus 
on a part of the image that is further away, 
etc. The advantage to this method is that 
you can find out right away where every- 
thing is and how sharp it is. The disadvan- 
tage is that it is rarely possible to generate 
sharp regions if you have failed to make an 
image that would be necessary for doing 
so. This would mean that the images you 
have made turn out to be useless. 

e Touchscreen: Lots of modern cameras have 
a touchscreen for setting focus and resolu- 
tion. This simplifies the creation of images 
when compared to manual procedures. 
The touchscreen method also lowers the 
risk that you will overlook a region. A word 
of advice: Make more images than you 
need rather than too few. A possible down- 
side here is that this method offers only 
limited precision when capturing regions. 

e Camera focus stacking functions: Better 
cameras today come with special focus 
stacking functions as part of their menu. 
These functions vary from manufacturer 
to manufacturer and according to the 
camera model. One camera from Olym- 
pus works as follows: You specify a 
focus step and the number of steps, both 
as absolute values. You then locate the 
closest point on the object. When releas- 
ing the exposure, the camera generates 
the number of images you have specified 
in the steps specified. The disadvantage 
to this camera is that it takes some expe- 
rience to figure out suitable parameters. 
The advantage is that the camera is easy 
and fast to use. 
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StopPinc DOWN 


Stopping down is a technique by 
which the aperture of a camera's iris is 
reduced with the aim of increasing the 
depth of field (i.e. a longer range is in 
focus). The more you close the iris, the 
longer the focal length, but the less 
light reaches the image sensor of a 
digital camera or film of a film camera, 
resulting in darker pictures. You can 
compensate for this by lengthening 
the exposure time, that is, increasing 
the time the shutter is open, which is 
inconvenient without a tripod or for 
moving objects moving; or increasing 
the ISO on a digital camera; or using a 
film with higher speed with an analog 
camera. 


Focus STACKING AND Microscopy 


The focus stacking method was origi- 
nally developed for the field of mi- 
croscopy, where the depth of field is 
ordinarily just a few micrometers in 
size. Given this limitation, it is practi- 
cally impossible to generate a sharp 
image without using microscopy. It 
should not come as a surprise that 
some of the best instructions and in- 
formation comes from related Internet 
sites. This site [1] provides a short and 
easily understood set of instructions, 
which are also based on enfuse and 
other tools. 
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DESKTOP 


Focus STACKING 


Figure 2: Four layers and some edge definition were sufficient for this image. This is due to the 
relatively small lens in comparison to the size of the image. 


HIGH RESOLUTION IMAGES 


Modern cameras like the OMD-5 
(Mark Il) are able to generate images 
with a resolution of more than 
7000x5000 pixels. The RAW files from 
these type of images are about 100MB 
in size; the JPEGS are at least 20MB. 
However, some restrictions accom- 
pany images made with this camera. 
These include: 


+ Itis absolutely necessary to use a 
tripod, because the images are gen- 
erated out of eight different parts. 


e Currently, you have to go through 
an additional step and manually ac- 
tivate the generation of RAW files. 


+ You will need several seconds of 
time for each image. These images 
are therefore only suitable for non- 
moving objects. 


+ The automatic focus stacking func- 
tion can no longer be used. You will 
have to release exposures of the 
partial images manually. 
+ The alignment (align_image_ 
stack) is still unable to handle these 
images properly. Therefore you 
should try to achieve the best possi- 
ble alignment. 
+ The processing times for larger 
images of this type is significantly 
longer. Batch jobs may be a solu- 
tion. 
Figure 3 shows that it pays to work 
with high resolution images. 
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It is a good idea to pay careful attention to the 
first image, which is the one that is closest to 
the lens. It is easy to make mistakes while cre- 
ating this image, because it often contains 
non-visible regions in the foreground. A good 
habit here is to make additional images of this 
region for the stacking series. These prove 
helpful if you want to manually correct some- 
thing (Figure 2). 

Another piece of advice is that you should 
take lots of photographs. You should try out 
different variations instead of sticking with 
just one. The best thing to do is to make 12 
photos, or better yet 20. It takes some time for 
you to develop an eye for the correct angle, 
lighting, etc. Practice makes perfect. 


COMBINING IMAGES 

The partial images have to be aligned on top 
of one another as precisely as possible even if 
you want to process the images automatically 
or just very quickly. Alignment can prove to 
be more difficult than it might at first seem 
even if you have used a tripod when making 
the images. Figure 4 shows that the smallest 
of flaws stands out on a macro photo. 

The task of alignment can often be accom- 
plished using simple tools like the command- 
line program align_image_stack from the 
Hugin suite of programs. This program has a 
simple syntax: 


align_image_stack <options> 2 


<input files> 


The input files are read and analyzed and 
then written to the current directory as 
numbered output files, potentially with a 
prefix. In the process, the command con- 
siders movement and distortions existing 
between the input files, and then if possi- 
ble, it generates the output files so that 
they are congruent. 


Table 1 shows the most important options 
of the command. 

A practical tip: Except for the options -m, 
-a, and possibly also -v, you will not need any 
additional options to achieve sufficiently good 
alignment if you have good input files. How- 
ever you should try out -gpu to see whether it 
increases the processing speed significantly. 
Should problems occur, it is a good idea to 
turn to -d (-distortion), -i, and -t, as well as 
-use-given-order. 

A typical sample example in the directory 
for the input files looks as follows. 


align_image_stack -v -m 2 


-a align *jpg 


This generates the aligned files align0000.tif, 
align0001.tif, align0002.tif, etc. The output 
format TIFF is a good choice here. This type 
of file supports an alpha channel that in turn 
uses enfuse if it is available. If you use this 
command call frequently, then you should 
define an alias: 


alias ALIGN='align_image_stack -v 2 


-m -a align’ 


If align_image_stack does not produce good 
results, then you still have the possibility of 
putting the image parts in place manually. 
This is not a problem with Gimp. First, you 
should load one partial image and then the 
next one as a new layer. This is done using 
Open as Layers ... in the File menu. You 
should now change the layer Mode of the up- 
permost layer to Extract grain. Image parts in 
the layers that are identical will then appear in 
gray (Figure 5). 

You can use the dragging tool and the cur- 
sor buttons to put the upper layer in place as 
best you can, as shown in Figure 5. If the lay- 
ers lay exactly on top of one another, then the 
contours will disappear into a uniform gray 
tone. However, it is often not possible to place 
the layers perfectly. If you have this problem, 
place the images as nearly as possible to the 
regions where you want to use sharp regions. 
Then you should change the layer mode back 
to Normal and right-click on the topmost 
layer and add just an alpha channel with Add 
alpha channel from the pop-up menu. Then 
erase the image regions that are unsuitable or 
not sharp. Figure 6 shows the result. 


MERGING WITH ENFUSE 

The standard tool for actually merging partial 
images into a composite is a free tool called 
enfuse [2]. This program is unique in that it 
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has a special algorithm, known as the Burt- 
Adelson [3], which can detect regions that are 
in focus and also create seamless transitions 
in brightness across across multiple images. 
You need both of these capabilities when 
focus stacking. 

The enfuse program is available as com- 
mand-line software under Linux, Windows, 
the Mac. Using it is easy: 


enfuse <options>... <input files> 


The input files must be aligned exactly. Other- 
wise, you will get shadow images like the 
ones shown in Figure 4. Of course, TIFF files 
generated with align_image_stack make for a 
good choice. Normally, enfuse processes the 
images in the sequence you have specified. 
Sometimes, however, this does not make 
sense. If so, you can define the sequence as 
desired using the Response-Files. Response- 
Files are used in place of the input files and 
tagged with an @, as in: 


enfuse ... @<response-file> 


enfuse was developed as a global program for 

merging images. It is also used for HDR im- 

ages. Consequently, numerous options come 

into play for optimizing outcomes. Many of 
the program options, for example those for 
focus stacking, have strange default settings. 

Table 2 shows enfuse‘s most important op- 

tions. 

The options shown in Table 3 control the 
visual results. Many of the options rely on ar- 
guments in the form of floating point num- 
bers between 0 and 1. When using the focus 
stacking function, you should always state the 
options —hard-mask and -contrast-weight = 1. 
The options -exposure-weight = 0 and -satu- 
ration-weight = 0 support these. Some of the 
options presented here can only be used in 
the command-line version as they are not cur- 
rently supported by GUIs. 

Apart from the options shown in Tables 2 
and 3, there are a series of additional and very 
special options that can improve results: 

e -contrast-window-size = < size > defines 
the size of the “local contrast analysis” win- 
dows in pixels. An increase of 5 can some- 
times improve the results, and it helps to 
prevent halos. 

e -gray-projector= < type > controls the way 
that the relevant regions of the images are 
computed during the contrast analysis. The 
default setting is average. Other possibilities 
include anti-value, l-star, lightness, lumi- 
nance, pl-star, value, or channel-mixer. The 


Figure 3: High resolution images made with macro photography are impressive. This image was 
constructed from four layers and then manually reworked. However, you can clearly see that more 
layers should have been used. 


last alternative is supposed to be the best, 

but it requires advanced knowledge of the 

channel mixer, which is controlled using 

three parameters. Otherwise, the Lstar al- 

ternative produces fairly good results. 
There are many other options that are only 
used in isolated cases. The original documen- 
tation [4] describes these in detail. Some tips 
on these parameters are also found in Pat Da- 
vid’s blog [5]. 


MAacroFusion 

Since most users do not get overly excited 
about using a command-line program, a 
graphical interface like MacroFusion has been 
available for some time for align_image_stack 
and enfuse. This Python program is a varia- 
tion of the enfuse GUI, and it should run on 
all distributions. However, it offers only sim- 
plified options and possibilities. In particular, 
it lacks a capability for saving masks, and it 
also cannot load masks that have been saved. 
You will find more than enough instructions 
online, some of them excellent, for how to use 
this tool. Figure 7 shows how the interface 
looks when it starts. 

MacroFusion combines align_image_stack 
and enfuse in a single interface, but it has only 
some of the functions you will need and oth- 
ers that you won't. First, you should load the 
desired input files using the Add button in the 
upper-left window. You can decide later 
which images you want to individually deac- 
tivate in order to test for effects. MacroFusion 
deposits the temporary files generated in this 
way in the ~/.config/mfusion/ directory. You 
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Figure 4: Even small flaws stand out on composites that have been generated automatically. Large 
laws require manual corrections. 


TABLE 1: ALIGN_IMAGE_STACK OPTIONS 


Option Function 


-o <output file> Merges the files into one high dynamic range (HDR) image. 
This option is NOT used for focus stacking. 


-a <prefix> This option produces aligned image files. Typically the term 
“align” or something similar is used. If you specify a directory/ 
then align_image_stack will set this up and write the output files 
to the directory. 


-V Verbose — triggers detailed messages, which can be important 
when problems arise. 
-e Interprets the input files as “full frame fish eye” images when 


the images are made with a corresponding lens. The default in- 
terpretation is for rectilinear images. 


-l Interprets the input files as linear. 


-t <pixel> Sets an error limit in units of pixels for control points. Large de- 
viations cause the program to ignore the command and look 
for other control points. 


-c <number> Defines the number of control points that are used, by default 
this will be 8. 
-mM Generates an optimized field of vision except for the first image 


shot. It is used during the focus stacking process and helps to 
even out small deviations in the images. 


-d Distortion - lets you have minor deviations in rotated and dis- 
torted images for the purpose of accommodating lens distor- 
tions. 

-i Smooths out minor movements of the input files. 

--distortion Takes the information from the Lensfun database into account 


in order to remove distortions. This command is useful if the 
object you are using is included in this database. 


--gpu Uses the GPU for computing. The command can deliver results 
much more quickly, or not, depending on your hardware. 


--use-given-order | By default the align_image_stack option arranges the input files 
according to the lighting stored in the Exifdata. Using this op- 
tion, you can specify the sequence directly in the command 
line, a feature that is potentially helpful when dealing with 
alignment problems. 


should make sure that the directory has 
enough free space. 

Next, you will need to select options for en- 
fuse. Before doing so, you should activate the 
automatic alignment option using the Align 
checkbox, which is found under Align im- 
ages. This section contains the options for 
align_image_stack. Automatic alignment is 
not always a good idea when you are dealing 
with high resolution images. See the “High 
Resolution Images” box for more information 
on this topic. Autocrop crops the output image 
so that all of the edges are clean. The other 
two options complement this feature. 

There are three tabs in the middle of the 
window where you set the options for enfuse. 
These are the Fusion, Expert, and Configura- 
tion tabs. 

Basic settings can be specified under Fu- 
sion. Figure 8 shows the settings that are im- 
portant for focus stacking. You should refer to 
the information above to figure out whether 
you need other settings. 

The Force HardMask option in the Expert 
tab is essential to achieving good results. Con- 
trast window corresponds to the -contrast- 
window-size = and Gray Projector to the 
~gray-projector = options (Figure 9). 

Normally, there is not much you will need 
to modify under Configuration if you do not 
have a large display screen and lots of RAM. If 
your screen and RAM are large, then you can 
adapt the preview size since the default size 
causes details to get lost. This means that 
problems might become visible only once the 
image is finished. The output options for 
JPEG and TIFF images are also found here. 
You might want to modify these. Copy exif 
info incorporates the EXIF data of the partial 
images in the newly generated all-in-one 
image. 

You can generate a preview with Preview 
using the current settings. The Before/After 
buttons are there for you to figure out 
whether these settings are better than ones 
used before. One click brings up the result 
achieved with the previous settings in the pre- 
view window. 

Images that have been manually gener- 
ated with align_image_stack and enfuse 
often look better than those prepared with 
MacroFusion. This illustrates the fact that 
some of the necessary options are still not 
available and therefore cannot be acti- 
vated. It is possible for you to exclude indi- 
vidual images from the processing by deac- 
tivating the images in the Photos window 
with a checkmark. In many cases though, 
this does not prove to be sufficient. 
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These types of mistakes are often found in 
high resolution images (see again the “High 
Resolution Images” box). They have to be 
more precisely aligned and merged in order to 
get a good results. To do so, it makes sense to 
use the -d (distortion) option and the possibil- 
ity for manually processing masks that are 
both missing from MacroFusion. 

Another peculiarity involves the sequence 
of the images. Normally cameras generate im- 
ages in the correct sequence. If you generate 
the images manually, then the files have to be 
arranged accordingly. This is not possible 
with MacroFusion. Instead, you have to use 
the command line. However, it is sufficient to 
create the correct sequence for align_image_ 
stack. The TIFFs that have been aligned can 
then be processed with MacroFusion. 


Masken BALL 

Users experienced in image processing will 
probably like to use the -save-masks and 
-load-masks in enfuse. The first of these gen- 
erates two masks in the work directory for 
every image file that has been read in and 
processed. These two masks include hard- 
mask- < Number > and softmask- 

< Number >. 

The soft masks are generated automati- 
cally. The hard masks appear with the 
-hard-mask option. These masks contain 
masks that are constructed with the algo- 
rithm referred to above and which detect 
the sharp regions of an image. ~hard-mask 
also lets you use the hard masks for merg- 
ing images. Figure 10 shows a mask like 
this. The white regions are used by the un- 
derlying image during merging. The black 
regions are discarded. 

Soft masks are always generated by default 
in enfuse as softmask*.tif. They contain soft 
transitions between individual images. They 
are therefore gray stage images in contrast to 
the black and white hard masks. 


TABLE 2: ENFUSE OPTIONS 
Function 


Option 


-l <level> 


Defines the number of levels used for the analysis. By default, enfuse uses automatic recognition 
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Figure 5: Gimp lets you align layers manually. You should use the Extract grain layer mode for the 
op layer . 


These masks are intended for the overlay of 
high resolution HDR images and are only 
suitable for the tasks lying ahead of them in 
focus stacking if they have been thoroughly 
processed, for example with the curve tool. 
Usually, you will get better results more 
quickly with the hard masks than with the 
soft ones. 

There are two possibilities for using these 
masks. To do so, you should load them in 
Gimp so that you can then modify them with 
a paint tool (for example, you could use either 
a soft pencil or a hard brush). You could also 
even think about using the calligraphy tool, 
which would let you generate very hard edges 
in the mask. Next, you should write over the 
original version with the modified mask and 
use it with -load-masks. 

Alternatively, you could use the masks di- 
rectly in Gimp. This involves a somewhat ad- 
vanced technique that also offers interesting 
possibilities. To get started, you should load 
the image belonging to the mask, for example 


Figure 6: The result of a focus stacking series 
that underwent a moderate amount of manual 
processing. 


(“auto”) of the required level. Typically, you do not have to manually adjust the level in the range be- 
tween 1 and 29. Larger values do not automatically produce better results, but they always use up 
much more computing time. Sometimes though it is also very helpful to merge using more levels. 


Sets the name and the format of the output file. The default format is a TIFF. With the help of com- 
pression, you can also generate compressed TIFFs (compression= deflate, Izw, packbits, none). 
jpeg=<compression> accepts compression levels from 0% to 100%. 


-o <output file> 


Defines the color intensity for TIFF output. Achievable levels of intensity include 8, 16, 32 and the 
variations r32 and r64 that are based on floating point numbers. 


-d <intensity> 


Displays the supported image formats. 


Verbose —causes enfuse to annotate the work in more detail. This is often quite useful. 


-show-image-formats 


-v [<level>] 
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> DESKTOP Focus STACKING 


macropusion 


Figure 7: The MacroFusion interface consists of multiple parts. The Figure 8: The basic settings for focus stacking are found in the first tab. 
input files are above, the options are to the left, and the preview plus 


other functions are at the bottom. 


Preview 
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l se onin m ovane Figure 10: This is how the masks generated in enfuse using the --save- 
Figure 9: You should remember to activate the Force HardMask (--hard- masks option look. They can be loaded in Gimp and manually pro- 
mask) option in the second tab in order get good outcomes. cessed. 


TABLE 3: ENFUSE Options (II) 


Option Function 

—exposure-weight= Determines how much the lighting will be considered. The default value is 1.0 for focus stacking. 
<floating point num- 

ber> 

~saturation-weight= Controls the influence of saturation on the algorithm. The default value is 0.2.0 for focus stacking. 
<floating point num- 

ber> 

-contrast-weight= Defines the influence of the contrasts. The default value is 0.1 for focus stacking. 

<floating point num- 

ber 

-~contrast-edge- Controls edge recognition. The floating point number should normally fall in the range between 0.1 to 
scale= <floating point | 0.5. Each unit represents a pixel. A beginning value of 0.3 is recommended for experiments. This param- 
number> eter should lead to improved sharpness under certain circumstances. Some users recommend not indi- 


cating the parameter --contrast-window-size= when using --contrast-edge-scale=. This parameter cannot 
be used with the enfuse GUI because it is only possible to enter whole numbers in this field. This restric- 
tion is a well-known bug. 


--save-masks Prevents enfuse from automatically deleting masks that have been used. You can analyze, manipulate, 
and reuse these masks. The program stores them in <type>-<number>.tifformat. You can assign another 
argument to this option with a different naming scheme (notthe file names for the masks), which would 
then have to also be stated with --load-masks. 


--hard-mask Uses “hard masks” as needed for focus stacking. 
--load-masks Lets masks load instead of recomputing them. This means you can use masks that have been manipu- 
lated. 
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align0001.tif. You should prepare this image 
by adding a layer mask by clicking on the 
Layer menu and then Mask and Add layer 
mask. 

Next load the mask as an additional layer 
using the Open as layer... in the File menu. 
Then using Ctrl + X followed by Ctrl + V, you 
can cut this layer out and add it to the clip- 
board and also as a floating selection in the 
image. You then add it to the layer mask with 
Anchor layer in the Layer menu (Ctrl +H). 

Now you will see the effect that the mask 
has (Figure 11). You can modify this mask 
manually and immediately observe the effect. 
One thing to note here is that you might want 
to see exactly one layer at a time during pro- 
cessing. Clicking on the eye of the layer in the 
layer dock while holding the Return key lets 
you temporarily turn off visibility for all other 
layers. 

It can be essential with hard masks to 
create certain transitions in order to 
achieve realistic results. This is accom- 
plished with Gimp by first loading the 
mask as a standard image. Then you 
should select all of the white regions with 
the global color selection, extending the se- 
lection via enlarge ... and hide from the Se- 
lection menu. Next fill the new selection 
with white. The outcome will be a some- 
what larger selection with slightly softer 
edges with which you can then soften the 
transitions. 


REWORKING AN IMAGE 

The Processing button in MacroFusion 
starts the image processor you have speci- 
ied in the Configuration tab under Edit 
with. Most of the time, this will be Gimp. 
Frequently, it will be necessary to rework 
the images that have been generated. Fig- 
ure 12 illustrates a typical problem. The 
very good output images and the use of the 
layer mode “hard edges” for combining the 
layers are responsible for the excellent 
sharpness of this image. However, this 
leads to colored artifacts that subsequently 
need to be edited, for example by removing 
the colors, adapting to color temperature, 
etc. 


CONCLUSION 

You can generate very good macro photos 
with focus stacking under Linux. However 
there are some issues involved. You will 
need to practice with lots of sample images 
before you can generate truly good images 
and understand how many levels you 
should use. Complex objects like those in 


Figure 12: Some typical problems are shown here. The artifacts at the lower edge of the screen 
need to be removed manually. These are not present in all of the input files. The color errors are 
also in need of correction. 


the previous figure are difficult to create 
and require a lot of effort. 

MacroFusion serves as the interface for the 
programs used for this technique, and it pro- 
duces results quickly. However, command-line 
applications often yields better results. In par- 
ticular, using your own masks (—save-masks, 
~load-masks) expands the possibilities greatly. 

And finally, it doesn’t take much more to 
begin manual image compositing. If you 
make do without automatic alignment via 
align_image_stack, you can create images of 
optimal quality that you can then merge in 
high color intensity with Gimp starting with 
version 2.9. This method is not practical for 
moving objects. 
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[1] Focus stacking in microscopy: 
http://www.microscopy-uk.org.uk/ 
mag/artjun09/rp-stack.html 

[2] enfuse: http:/enblend.sf.net 


[3] Burt-Adelson: https://en. 
wikipedia.org/wiki/Pyramid_ 
(image_processing)#Gaussian_ 
pyramid 

[4] Original documentation: http 
enblend.sourceforge.nevenblend.doc/ 
enblend_4. 1.xhtml/enblend.xhtml 

[5] Pat David's blog: http:/blog. 
patdavid.net/2013/0 1/focus-stack- 
ing-macro-photos-enfuse.htm! 
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Staying on top of stock inventory levels will allow you to plan for capacity and profit. 
PartKeepr will help you out. 


Managing an Inventory with PartKeepr 


TAKING STOCK 


BY ERIK BARWALDT 
lanning ahead as a business stay on top of their parts inventories 
person is the basis of commer- in order to figure out whether they 
cial success. The more items have adequate quantities of every 
you have in stock, the more they need, or whether they are run- 


important it be- ning out of certain parts. Linux and 
=> comes to the free software PartKeepr bring or- 


maintain a ganization to your inventory. 
current inven- Because of the way it is con- 

tory overview. structed, PartKeepr is suitable for all 
Manufacturers inventories from small to large. 

also have to However, this suitability depends on 


the presence of a professional envi- 
ronment based on LAMP (Linux, 
Apache, MySQL/MariaDB, PHP/Py- 
thon/Perl). The LAMP software 
stack provides not only 
a database back 
end, it also lets an 
Apache web server 
issue queries and 
make entries on the 
company intranet 
from any worksta- 
tion. 

PartKeepr, for- 
merly known as 
PartDB2, is 
available as 
free soft- 
ware under 
the GPLv3 
license, and 


Preequivtes a Aulpeetiabin Kay e Enlai Contuel 


| This wizard guides you through the setup of PartKeepr, 


@PartKeepr 


| Note that you can re-start setup any time, even if you already have an existing database. No existing data will be overwritten. 


| Wyouare upgrading, make sure you created a backup of your database and filesystem! 


x Error Details 


date.timezone setting must be set 


‘simplexmi_import_dom() must be available 
Install and enable the SimpleXML extension. 
GD not found 

ine tne eo library extension 


CURL library not found 
Install the CURL library extension 


The php.ini file used: /etc/php/7.O/apache2/php int 
Read more... 


OK 


{x} 


Set the “date.timezone" setting in php.init (like Europe/Paris). 


Figure 2: First the software tests to see 


to retrofit by installing some modules. 


Next 


Figure 1: The actual set up nek PartKeepr takes place in the web browser. The preparations are per- 


formed in the filesystem. 


it comes with a large community of 
users and developers. The software 
is available in various forms on the 
project page [1]. In addition to ZIP 
and TBZ2 archives, there is also a 
virtual appliance for Oracle’s Virtu- 
alBox. However, the virtual appli- 
ance does not host the current ver- 
sion of PartKeepr, plus it runs with- 
out a firewall. As a result, the vir- 
tual image, which is approximately 
555MB, is suitable only for testing. 

The software as such is not very 
demanding. There are no installation 
problems under Ubuntu 16.04 LTS . 
Lots of other inventory management 
solutions crash with the PHP 7 envi- 
ronment. 


INSTALLATION 

The current version of PartKeepr 
needs, as mentioned above, a func- 
tioning LAMP environment. First 
download PartKeepr as a ZIP file 
(around 71MB) from the website and 
decompress it in the desired direc- 
tory [1]. Then move the folder with 
the decompressed data to the docu- 
ment root for your web server. As a 
rule, this will be /var/www/. After 
this, activate the Apache modules 
userdir and rewrite: 


ListinG 1: ADD TO APACHE2.CONF 


<Directory /var/www/partkeepr-1.1.0/> 


AllowOverride All 


</Directory> 
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# a2enmod userdir rewrite 


Now change the Apache configura- 
tion and insert the lines from Listing 
1 into the file /etc/apache2/apache2. 
conf with a text editor. 

Next you should adapt the root di- 
rectory by using administrator rights 
to copy the /etc/apache2/sites-avail- 
able/000-default.conf file, as well as 
name your chosen virtual host. 
Using the text editor, then modify 
the DocumentRoot section so that it 
includes the path /var/www/part- 
keepr-1.1.0. In order to access the 
site via an SSL connection, you 
should also modify the Document- 
Root section in the corresponding 
copy of the /etc/apache2/sites-avail- 
able/default-ssl.conf file in the same 
way. 

As part of the last step, modify the 
maximum run time of a script and 
enter the current time zone in the 
php.ini file. If you are using PHP 7, 
you can do this by opening and edit- 
ing the /etc/php/7.0/apache2/php. ini 
file. If you are working on an older 
system that has PHP 5.6x on board, 
this file will be located in the /etc/ 
phpS/apache2/ directory. Once in 
the file, increase the value for the 
variable max_execution_time from 
30 to 120. In the date.timezone = 
line, enter the time zone for your lo- 
cation. 

Next use root rights to restart the 
web server by typing service apache2 
restart in the terminal. Now you can 
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whether the system has fulfilled all of the 
requirements. During testing, it was necessary 
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Figure 3: The parts manager appears after login. Here it is already well accessorized. 


call the corresponding URL for the 
virtual host from the browser and at- 
tach /web/setup to the host (Figure 
1). 


SETUP 

Once you click on the Next option in 
the lower left of the setup screen, 
the program will check to see 
whether all of the requirements are 
fulfilled. Under certain circum- 
stances, it will display components 
that are missing or outdated, which 
you should then update. At this 
stage during testing, it was neces- 
sary to add several PHP modules as 
retrofits. 

A single click on the Show Errors 
button yields detailed information 
on the missing modules and other 
problems (Figure 2). You can use the 
package manager to easily install 
these packages. Then you should re- 
start the web server from the com- 
mand line with service apache2 re- 
start. Afterwards, check on the sta- 
tus again by clicking on Re-run 
checks within the browser. 

Authentication data goes into the 
additional setup tabs, and you must 
also configure the MySQL database. 
The name of the corresponding com- 
puter gets entered in the Database 
Hostname: field found under Data- 
base Parameters. Enter the name 
PartKeepr in the Database Name: 
and Database Username: fields. The 
password of your choice goes into 
Database Password:. 

Then activate the option Show 
commands to create the database, 
which sits to the right of the entry 


fields, and copy the commands that 
are indicated to the clipboard. 
Switch to the terminal and log in to 
the database on the corresponding 
computer using mysql -u root -p with 
the original MySQL password. Copy 
the commands from the clipboard to 
the command line. Now the database 
has been set up with the password 
as specified. You can get out of the 
database interface by typing quit at 
the prompt. 

Continue on to the next tab in the 
setup window. In this tab, the rou- 
tine configures the system, a process 
that usually takes some time. Enter 
the data into the User Data tab that 
the software administrator will be 
using for authentication. When en- 
tering the password, make sure to 
enter uppercase and lowercase let- 
ters correctly. The configuration 
does not ask twice for verification. 

After clicking on Next, the setup 
switches to a tab that suggests the 
possibility of securing the data via 
cron jobs. If you click on the Submit 
option in this window, you will land 
in the software’s login screen. After 
entering the authentication data, the 
home screen for the program ap- 
pears (Figure 3). 


INTUITIVE 

The software offers a unified, intui- 
tive operation that even beginners 
can master. Depending on your loca- 
tion in the program, you will see 
screens that are divided into two or 
three areas. To the left, there is a list 
area with a tree view of the cur- 
rently active components. To the 
right is a large entry and indicator 
area where you can either view or 
collect detailed data about these ac- 
tive components. 

In addition, PartKeepr offers corre- 
sponding masks with relevant data 
fields. These are oriented to typical 
warehousing categories for compo- 
nents. In the upper area of the pro- 
gram window, there is a horizontal 
tab bar. Above this, there is a small 
menubar with three entries, System, 
Edit, and View. Each of these con- 
tains all of the important submenus 
and groups. 

The software displays multiple cat- 
egories in parallel in the individual 
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tabs. Therefore you do not need to 
constantly call individual groups via 
the menu. Instead you can click your 
way through the appropriate tabs to 
the desired page. Listing and manag- 
ing components works in a similar 
way. There are buttons above each 
list to the left of the screen for creat- 
ing and deleting individual entries. 


ACCESSORIES 

In the application’s home window, 
you will find the Edit entry in the 
menu above the list. This entry takes 
you from the corresponding category 
to all of the important information 
pertaining to the components. The 
information includes everything, 
ranging from the manufacturer and 
distributor, to technical data, to stor- 
age location. The first order of busi- 
ness is to define the storage loca- 
tion. This is done by selecting Stor- 
age Locations, which will open a 
new tab with a three part dialog. 

In the lower left of this tab, click 
on Add Storage Location to add a 
new entry to Storage Location. Then, 
to the right of the screen, indicate 
the name. You can also load a pic- 
ture. Save your data by clicking on 
Save Storage Location in the lower 
left. 

The new entry appears immedi- 
ately in the lower left of the list 
screen. An empty table will open on 
the right. It will show the parts 
found in the given location. 

The next step involves listing the 
reference data for the manufacturer 
and supplier. This data is then as- 
signed to each individual compo- 
nent. To do this, first go to the Edit 
menu and open Manufacturers. An 
extensive, ready-made list of manu- 
facturers will appear to the left of 
the window. If relevant entries are 
missing from this list, open a mask 
to create a new dataset by clicking 
on Add Manufacturer at the top left. 
This is where you enter all of the 
relevant data including a logo if you 
wish. Clicking on Save Manufacturer 
saves the new data. 

It is important to make sure that 
the ready-made list of manufacturers 
contains the company’s name and 
logo, but not individual data like the 
address, telephone numbers, or con- 
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Figure 4: In order to maintain an overview of the sources for your parts, you collect detailed manu- 


facturer information. 


tact person. This information should 
be manually entered after clicking 
on the relevant entry (Figure 4). 

The list of ready-made entries con- 
sists of multiple pages. A search 
field above the list makes it possible 
to quickly find an individual pro- 
vider. Similarly, you can create en- 
tries for distributors. The corre- 
sponding menu option is found 
under Edit > Distributors. 


CATEGORIES AND PARTS 

You in-stock components are man- 
aged in the Part Manager category. 
When you start using the program, 
the Categories list, located to the left 
in the window, will be empty. This 
is where you create new categories 
that include all parts of the same 
type. For example, this could be an 
electronic components category, 
which would include things like re- 
sistors, diodes, or transistors. The 
individual groups can extend across 
multiple hierarchies. They subse- 
quently appear in a tree view. 

In order to create a new group, 
first click on the Root Category op- 
tion and then on Add Category, 
which is located in the middle above 
the list. Enter a name and brief de- 
scription for the new category in a 
free text field in overlapping win- 
dows. After saving the entries, a 
new group will appear underneath 
Root Category. 

In order to create subgroups in 
this hierarchy, instead of clicking on 
the Root Category option, click on 
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Figure 5: The dialog for the individual in-stock parts lets you link much of the data that you previ- 
ously entered as independent sets when building the database. 
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Figure 6: In order to maintain an overview of the dimensions that each entry represents, you can 
manage the units in the software. 


the instance found underneath; af- 
terwards, click again on Add Cate- 
gory. Remove obsolete categories 
with Delete Category in the small 
buttonbar located to the far right 
above the list. 

Once you have built your structure 
for managing components, start list- 
ing the parts you have in stock. To 
do this, click on Add Part to the 
right in the program window. A new 
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dialog will open with four tabs that 
include Basic Data, Distributors, 
Manufacturers, and Attachments. 
This is where you enter detailed in- 
formation for each component (Fig- 
ure 5). 

In the Basic Data tab, you can col- 
lect data such as the actual label 
plus quantity, price, and a descrip- 
tion. If necessary, you can also enter 
a definition for the condition and an 
internal parts number. Using the 
Category: and Storage Location: 
fields, you can link the article to a 
group of components and a storage 
location. When you click on the tri- 
angle to the right of each of these 
data fields, you will get a selection 
list for the data that has already 
been deposited. 

The Distributors tab lets you link 
the entry to one or more distributors 
of the the corresponding parts. Click 
on Add and select the desired entry 
from the list. Then you can indicate 
the order number for the part, the 
packaging unit and the price of a 
single unit, and price per unit. 

In the Manufacturers tab, clicking 
on the Add option lets you select the 
suitable entry from the list of saved 
manufacturers and enter the accom- 
panying part number. You can in- 
clude things like technical data, 
specifications, and the URL for a 
web site in the last tab, Attach- 
ments. If locally stored files exist, 
you can incorporate them, but the 
file size cannot exceed 12MB. After 
clicking on Upload, the software will 
accept the desired data. 

You can take a picture of the parts 
with a webcam by clicking on the 
camera icon button. These pictures 
will then be available in the tab as a 
Thumbnail View to help identify 
parts. 


UNIFORMITY 

PartKeepr is primarily intended for 
use with electronic components in- 
ventories. Some of these, such as 
CPUs or integrated circuits, have 
standard contact strips and grids for 
assembly. These components get sol- 
dered together or they are plugged 
into a suitable socket. Respectively, 
these are called Ball Grid Array 
(BGA) or Dual In-line Package (DIP). 


UBUNTU USER +» WWW.UBUNTU-USER.COM 


PartKeepr’s Footprint menu makes 
it possible to include the footprint 
for each item you list. In the dialog 
for each part, select the footprint in 
the Footprint: selection field. The in- 
dividual entries are listed centrally 
via the Edit | Footprints menu. The 
dialog here corresponds to the dialog 
for creating categories. 

Due to the wide array of existing 
units of measure in the field of elec- 
tronics, it is easy to forget what size 
goes with what unit. Here you can 
call up a list of predefined units via 
Edit > Units. The program will dis- 
play the appropriate prefix for each 
unit in the right hand area when you 
click on one of the entries in the list 
to the left (Figure 6). This helps pre- 
vent possible confusion that could 
be caused by incorrect interpretation 
of units. 

If you find that some items you need 
are missing, these can be added by 
clicking on the list’s Add Unit option. 
Delete a unit you no longer need via 
Delete Unit. You can manage quanti- 
ties of the units saved in the system 
for in-stock items in Edit | Part Mea- 
surement Units. If necessary, this is 
where you can add units using the 
Add Part Measurement Unit option. 


PROJECTS AND REPORTS 

In addition to individual parts, you 
can also manage project parts with 
PartKeepr. This is done by displaying 
all of the parts associated with a fin- 
ished assembled device. This function 
is located in the Edit | Projects menu. 
A click on the Add Project option lets 
you set up a new project. 

Next enter the project name in the 
large area to the right and add infor- 
mation where applicable, such as de- 
scription, necessary parts, and attach- 
ments. After clicking on the Save Proj- 
ect button, an entry will appear for the 
project in the list to the left of the pro- 
gram window. 

The software offers the possibility of 
creating reports. These contain statis- 
tical data, such as the number of parts 
in stock, and they also let you manipu- 
late the inventory. You can generate 
reports for individual projects with the 
menu option View | Project Reports. At 
the end of a project, you can automati- 
cally adjust the inventory by clicking 


WWW.UBUNTU-USER.COM + UBUNTU USER 


is still in the warehouse, and what parts have been included in a project. 


on the Remove parts from stock button 
in the Project Reports window. 

You can get an overview of develop- 
ments in the warehouse using the 
Stock History option in the View menu. 
You will see a list of all parts that in- 
clude the date on which they left the 
warehouse, the price, and the employ- 
ees who processed the part. Here the 
software also offers the possibility of 
exporting the list in another format, 
such as the universal CSV format with 
the Export button (Figure 7). 


CONCLUSION 

You can systematize your stock with 
PartKeepr. This software was primarily 
developed for use with electronic com- 
ponents, but it is also well suited for 
other branches that also deal with 
small parts, such as farm machinery 
repair shops. Shops like these have to 
keep track of everything ranging from 
gaskets, to lug nuts, to an engine 
block, and beyond. PartKeepr shines 
as a parts manager due to its conve- 
nient interface and speedy operation. 
Thanks to LAMP, it also has a stable 
and standard database framework 
working under it. e 


INFO 
[1] PartKeepr project page: https:// 


www. partkeepr.org 
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Ubuntu has turned the desktop inside out with Unity 8. However, Unity 8's new concepts do not 
always impress in their current state. 


The new Ubuntu desktop, Unity 8 


New DIGS 


BY PETER KREUSSEL 


nlike the Debian releases on 
which it is based, Ubuntu usu- 
ally has six month release cy- 
cles. Since its latest announce- 
ment of new functions, Canonical is run- 
ning further behind schedule than ever 
before. By way of example, a completely 
redesigned Unity 8 was already planned 
for Ubuntu 15.04. Moreover, the current 
release is still missing functions needed 


for every day use. However, you can in- 
stall the advanced version, unity8-desk- 
top-session, using the package manager. 

The Unity’s roots reach back to 2011 
and version 11.04. Prior to the appear- 
ance of the current stable version, Unity 
7, this Canonical desktop made do with 
the graphical X Window server that 
Linux has been using for ages. However 
this ancestor from the previous century 
gradually turned into an ever greater 
burden. Smartphones can all handle 
smooth 3D effects, but fade effects and 
scaling windows overtax a desktop. X 
Window runs as an independent process 
and window managers, like KWin in 
KDE or Mutter in Gnome, have to take 
several detours when it comes to anima- 
tion. 

In order to modernize the infrastruc- 
ture, some developers launched Wayland 
as a display server. If used with appro- 
priate the libraries and toolkits, Wayland 
simplifies the workings of the graphical 
interface. The Wayland protocol is much 
less complicated than the protocol for 
the X Window System, and it handles 3D 
acceleration right out of the box. Modern 
windows managers provide direct sup- 
port for the new functions, thus making 
an individual process for the server ob- 
solete. These improvements have been 
met with widespread approval for Way- 
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land from the community. As a result, 
KDE, Gnome, and Enlightenment have 
based their windows managers on Way- 
land and are gradually heading down 
that road. 

However, Canonical decided that Way- 
land was not sufficient to meet the re- 
quirements it had in mind for using 
Ubuntu on a smartphone. As a result, 
the company started working in 2013 on 
a display server called Mir [1]. Unity 8 
sits on Mir. The parallel efforts invested 
in developing Mir and Wayland show 
that it can take years to replace an estab- 
lished system component. The question 
arises as to whether and in what way the 
Unity 8 and Mir combo will ultimately 
grow into a modern desktop. 


ROLLER COASTER 
Unity 8 is actually already preinstalled in 
the final version of Ubuntu 16.10 (Yak- 
kety Yak). However, Unity 7.5 is set as 
the default desktop. After log out, the 
login screen offers the choice between 
the stable Unity environment and the 
new Unity 8 (Figure 1). 

If you select Unity 8, then the experi- 
mental desktop will start. During testing, 
the start-up was fast and smooth. The 
look and feel of Unity 8 is similar to that 
of KDE Plasma 5 as well as current ver- 
sions of Windows or Mac OS X. As with 
these other desktops, the 3D effects for 
Unity 8 are slick, unadorned, and un- 
complicated (Figure 2). 

Unlike the previous Unity desktop 
where the left bar remains visible until 
you change the relevant settings, from 
the very beginning, the bar in the cur- 
rent version only appears with mouse 
contact or by pressing the Super key (the 
Windows button). For now, the meager 
number of settings options don’t allow 
you to change this (Figure 3). 

Unity 7’s Dash, which is used for start- 
ing programs and is opened with the 
Super key, has given way to Scopes, 
which looks like an ordinary program 
window (Figure 4). 


Not Yet MATURE 

Even viewed with the best of intentions, 
Scopes does not represent a step for- 
ward. In fact, the window may remind 
older users of the program manager from 
Windows 3.1. You still have to inconve- 
niently click around on the interface in 
order to find the names of programs. 


WWW.UBUNTU-USER.COM + UBUNTU USER 


Geiben 


Figure 1: Unity 8 reveals its true purpose when you deactivate the desktop mode. AIl of the appli- 
cations start in full screen as a standard window and without a window bar. 


Figure 2: Unity 8 already has visual charm as shown here with the toggle for applications. How- 
ever, good looks are not helpful if you have to jump through hoops to start standard apps. 


tem Settings 
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Figure 3: The sidebar disappears when the cursor leaves its vicinity. There are currently no options 
to change this behavior. 
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Figure 4: The Scopes window with its bumpy search function can be moved freely on the desktop, 
but it does not yet work like a viable substitute for Dash from Unity 7. 
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Figure 5: Legacy applications, which currently consist of all programs except for a browser, need 
to be installed for a second time with Unity 8. 
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Simply typing in the name as you did be- 
fore is not enough. 

However, the biggest disadvantage to 
the new environment is that Scopes only 
displays System Settings and Browser no 
matter which programs you install on 
the system. It is not possible to open 
programs without a starter icon as you 
were able to previously with Alt + F2 or 
on the console. For the time being, stan- 
dard programs written for the X Window 
interface only start under Unity 8 with a 
detour. 

The X Window System does not run 
after login. Instead, only the display 
server Mir, which is Ubuntu-specific, 
will run. As a result, your regular apps 
need the intermediate layer provided by 


XMir and the Libertine container pro- 
gram. 
Install the Libertine with 


sudo apt install libertine 2 
libertine-scope iibertine-tools 


Currently, this program requires that you 
reinstall all of the programs for Unity 8 
in a container you set up beforehand 
(Figure 5). Fortunately, setting up the 
containers is mercifully straightforward. 

Another click on the entry for this new 
container lets you install Debian pack- 
ages from the Ubuntu repositories. Each 
program previously installed on your 
system is now integrated into Unity 8 
using this method, and it takes up twice 
the space on your disk. However, despite 
its clunkiness, the system does work, 
and your programs now appear in Scopes 
under Applications - to see them, drag 
down the upper “blind” in the Applica- 
tions scope to refresh. 


CONCLUSION 

When it comes to everyday use, hardly 
anybody will want to go to the trouble 
and waste the resources caused by paral- 
lel installation of parts of the system and 
all of the applications. Unity 8 can actu- 
ally only be considered as a technology 
preview - a preview that overall runs 
well, even given the limitations I have 
pointed out. 

The new graphical environment does 
not work together with the proprietary 
graphics drivers from NVidia and AMD. 
In tests performed on a virtual machine, 
Unity 8 got bogged down one time 
shooting the CPU load up to 100% and 
crashing the system. Perhaps this prob- 
lem was due to the virtual graphics card. 

However, during operation there was 
no way to tell that the graphical environ- 
ment is not based on the X Window Sys- 
tem but rather on the Mir replacement, 
which has been rewritten from the 
ground up. In the near future, Unity 8 
will probably mature enough to actually 
be useful. This however will probably 
happen “a la Debian,” that is, it will be 
ready when it’s ready. e 


INFO 


[1] Mir: https:/wiki.ubuntu.com/Mir/ 
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LXQt is a lightweight desktop environment based on Qt 5. The similarities to LXDE are no accident. 


An LXDE-like desktop made with Qt 


LET THERE BE LIGHT 


BY FERDINAND THOMMES 


hen dealing with Linux 
desktops, the letter “L” 
usually stands for 
“light.” This is especially 
true for the two lightweight X11 
desktop environments, LXDE and 
LXQt. Actually, the latter is halfway 
to becoming a complete desktop en- 
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vironment, as is apparent from its 
current version 0.11.0. However, you 
shouldn’t let the halfway mark fool 
you into thinking that LXQt is any- 
thing other than absolutely usable in 
its current state of development. I 
discuss this status below. 


LXDE AND RAzoR-OT 


Before delving into that topic, I want 
to first provide a brief overview of 
how the program came into being. 
Developers started the desktop proj- 
ect LXDE [1] in 2006, taking it upon 
themselves to create a lightweight 
desktop based on GTK. It was sup- 
posed to consume fewer resources 
than even XFCE, which was already 
very lean. 

In 2010, some Russian developers 
took note of the project. They appre- 
ciated the features that KDE and the 
Qt framework brought to the table, 
but they wanted a more lightweight 
version. They started the Razor-qt 
project [2] based on Qt 4. Progress 
was comparatively slow due to time 
restrictions experienced by the proj- 
ect participants. 

Finally, after three years, the de- 
velopers of LXDE and Razor-qt de- 
cided by consensus to implement an 
extra lean Qt desktop, LXQt [3]. The 
reasoning behind this decision was 
that finished parts of LXDE could 
simply be ported from GTK to Qt. 
Thus the developers would avoid re- 
writing parts of LXDE that were al- 
ready in place. 

A first version was released in May 
2014. It’s name, LXQt 0.7.0, was 
styled after Razor-qt. The developers 
achieved Qt 5 compatibility with the 
next release 0.8.0. This in turn made 
it possible for LXQt 0.9 to incorpo- 
rate some of the libraries that had 
been modularized during the devel- 
opment of KDE Frameworks 5. This 
move did away with the need for 
LXQt-specific libraries. 

Consequently, the KWindowSystem 
replaced the XfitMan in Razor-qt as 
the means for handling window 
events in the lxqt-panel, lxqt-runner, 
lxqt-session, lxqt-notificationd, and 
Ixqt-session modules. This signified 


INSTALLING LXQT 
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Figure 1: LXOt 0.11.0 has a classic desktop setup with fonts, wallpaper, and icons. 
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Figure 2: The developers have expanded pemanfm-qt with the addition of folder-specific settings. 


an important advance toward future 
compatibility with Wayland, the dis- 
play server for Linux that will even- 
tually replace the aging X Window 
server. 

The developers made it their goal 
for LXQt 0.10.0, which was released 
at the end of 2015, to smooth out the 
code. They managed to get rid of 


| discovered that installing the /xqt package with 


$ sudo apt install 1xqt 


was not enough. When | tried to log into the desktop, it would ask me to select a 
window manager, with no hint of where to find one. It turns out LXOt also requires 


Openbox: 


$ sudo apt install openbox 


Once that is installed, LXQt boots without any problem. 
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LXQt settings 
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Figure 3: The Configuration Center provides a multitude of possible settings. You can add a smart 


looking dock using Plank. 
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more than 400 errors, added dozens 
of translations, and integrated both 
of the Qt frameworks Solid and 
Libkscreen. In the process, Solid re- 
placed the Liblxqt mount and KfSId- 
leTime took over parts of the power 
management. Libkscreen, which is 
likewise compatible with Wayland, 
assumed the task of administering 
displays. 


Usine SIDUCTION 

I took a look at the current 64-bit LXQt 
0.11.0 (Figure 1). Immediately after 
starting, the new LXQt version takes 
up 258MB of space in main memory. 
On the hard drive, the size of the pro- 
gram is 3.4GB. The 32-bit version has 
an even smaller memory footprint. 

You can customize practically every 
inch of LXQt 0.11.0 using the updates 
and extensions that are offered. For in- 
stance, the file manager pcmanfm-qt 
(Figure 2) can now save folder-specific 
settings, and the address bar has auto- 
complete. The menu at the top of the 
application can be hidden; the panel 
at the bottom of the display has been 
upgraded to group applications and 
also be hidden. 

The developers have made signifi- 
cant improvements to the dialog used 
to create additional bars. The dialog 
menu now offers a search field. An- 
other item of interest in LXQt 0.11.0 is 
the application Pavucontrol-Qt, which 
includes almost all of the mixer set- 
tings from Pavucontrol for PulseAudio. 


Focus on QT APPLICATIONS 

LXQt 0.11.0 has a suitable number of 
lightweight applications that are based 
on a Qt foundation wherever possible. 
Useful tools for the desktop include 
Zim, a “desktop wiki” for writing 
notes or charting out a multi-page, hy- 
perlinked document; and conman, a 
utility used for connecting to remote 
consoles. Firefox helps you navigate 
the Internet. 

As mentioned in the “Installing 
LXQt” box, you need to install Open- 
box, a window manager, to actually 
get the desktop up and running. You 
also can install others: xfwm4 from 
XFCE is prettier, sleeker looking, and 
light. If this choice of manager does 
not resonate with you, then you can 
simply install and choose another one, 
for example KWin (sudo apt install 
kwin) and change from one to another 
using LXQt settings | Session Settings. 

You can get a dock by installing 
Plank (sudo apt install plank). Run 
Plank from the Accessories submenu. 
When it pops up at the bottom of the 
screen, hold down the Ctrl key and 
right click on the dock to move it 
around, for example, to the top of the 
screen, away from the bottom panel 
(Figure 3). If you have a wide display, 
it may make sense to move the dock to 
the side of the screen. If you want to 
add a new app to the dock, just open 
it; when its icon appears in the dock, 
right click on it and choose Keep in 
Dock. To remove an app from the 
dock, click and drag it out of the dock, 
and it will literally disappear in a puff 
of smoke. 


CONCLUSION 

LXQt is an appealing and easy-to-oper- 
ate desktop, especially for Qt fans. It 
has a footprint that is only slightly 
larger than that of LXDE. This makes 
LXQt great for extending the life of 
older computers. The super-customiz- 
able desktop can be adapted to the 
taste of each individual user. « 


INFO 


[1] LXDE: hAttp:/Ixde.org/ 
[2] Razor-qt: http:/razor-qt.org/ 
[3] LXQt: http:/Ixqt.org/ 
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Ubuntu 16.10 offers almost no changes 
to the installation process. But, in case 
you are new to Ubuntu, we'll walk you 
through upgrading or installing the 
latest release. 


f you've installed Ubuntu in the 

past, you might notice that, earlier 

versions up to 12.04, Ubuntu 16.10 

(Yakkety Yak) does not fit on one 
CD. As from 12.10 onwards, developers 
also improved the installer, which now 
provides full encryption and Logical Vol- 
ume Manager (LVM). The step in 13.10 
that allowed access to or set up of an 
UbuntuOne account was removed in 
14.04. Other than these updates, not 
much has changed with the Ubuntu in- 
stallation process. 

You can Install Ubuntu 16.10 on your 
computer or virtual machine in several 
ways. Although Ubuntu is geared to- 
ward novice Linux users, installing the 
system is different from a Windows in- 
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Try Ubuntu 


shouldn't take too long. 


You may wish to read the release notes 


Installing Ubuntu 16.10 


INSTALLATION 
MARTI cna 


stallation. We’ll explain your options 
and walk you through the steps. 


What's New, YAKKETY? 

If you’re running Ubuntu 16.04, you 
can update to version 16.10 directly. 
However, if you’re upgrading from a 
version of Ubuntu earlier than 16.04, 
you will have to update in steps to 
16.04 first and then to 16.10. If you de- 
cide to go with a clean install, try the 
Live version first to test the programs 
and get used to the Unity desktop. 
Then, you can load the distribution via 
the integrated installer on your com- 
puter. Regardless of what you decide, 
back up all your important files first so 
nothing gets lost in the process. 


Install Ubuntu 


‘You can try Ubuntu without making any changes to your computer, directly from this CD. 


Or if you're ready, you can install Ubuntu alongside (or instead of) your current operating system. This 


Figure 1: Choose Try Ubuntu to run a Live instance on your computer without installing anything. 
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INSERT MEDIA 

The double-sided DVD that comes with 
this issue provides two versions of 
Ubuntu: one for 32-bit and another for 
64-bit computers. To boot from the 
DVD, first have your computer recog- 
nize it as bootable. Often computers 
do this automatically; starting the PC 
with a bootable CD or DVD in the 
drive invokes the corresponding boot- 
loader. If the computer can’t find the 
DVD, change the boot order via the 
BIOS. 

To get to the BIOS, start up the com- 
puter and immediately press Esc, Del, 
F2, or F12, depending on your com- 
puter. Then, look for the appropriate 
option to change the boot order and 
move the CD/DVD drive to the top of 
the list. If you’re starting Ubuntu from 
a USB stick, move the USB device to 
the top of the boot order. In both 
cases, save the setting and restart the 
computer. 

If your computer is missing a DVD 
drive, use a USB stick. We will assume 
that you already have Ubuntu in- 
stalled. Create the stick by download- 
ing the ISO image for Ubuntu 16.10 for 
the 32-bit or 64-bit architecture [1] 
that your installed Ubuntu uses, then 
load it to the USB stick using the 
Startup Disk Creator app in Ubuntu 
(Figure 2). First, delete all previous 
files on the stick, leaving at least 4GB 
of free space. At the top of the Make 
Startup Disk window, select the down- 
loaded ISO image; and, at the bottom, 
select the USB device to use, then click 
Make Startup Disk. Booting from the 
USB stick requires the BIOS setting 
previously mentioned. 
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o Make Startup Disk 


To try or install Ubuntu from a removable disk, it needs to be set up as a startup disk. 


Source discimage (iso): 


CD-Drive/image 
i 


Diskto use: 
Device 


Os Version 


Capacity 


Close Make Startup Disk 


Figure 2: The Startup Disk Creator in Ubuntu 15.10 copies the Ubuntu 16.04 image onto a USB stick with 
the required free space. Both Ubuntu versions have to be for the same 32-bit or 64-bit architecture. 


To do a new installation, insert the 
DVD included in this issue into the 
drive with the label facing up for 64- 
bit architecture and down for 32-bit ar- 
chitecture, and then turn off the com- 
puter. Turn it back on and immediately 
hold down the Shift key, and you will 
get to the Ubuntu boot menu. Here, 
you can make a language selection 
using the F keys to set language, key- 
map, and boot parameters. 

Press F6 (Other Options) on the 
Ubuntu boot menu so that you do not 
land on the Ubuntu desktop. The win- 
dow has a Boot Options line at the bot- 
tom (Figure 3). Enter the boot options 
mentioned here instead of the default 
one quiet splash. The nomodest, rad- 


Figure 3: If booting doesn’t work, adjust the boot option in the Ubuntu boot 


menu 


eon.modeset, nvidia.modeset = 0, or 
nouveau. modeset = 0 options help if 
you have graphics problems and the 
screen stays black. The acpi=off boot 
option fixes power management prob- 
lems on older computers. 

If you do not want to Install Ubuntu 
right away, you can Try Ubuntu with- 
out installing. In Live mode, Ubuntu 
copies only the necessary programs 
into memory and executes them from 
there. Booting takes noticeably longer 
than with the installed version, and 
the system as a whole is a bit slower, 
but you can test Ubuntu 16.10 with lit- 
tle risk. Also look at the bundled ap- 
plications to see whether Ubuntu sup- 


noapic 

nolepic 

edd=on 

nodmraid 
nomodeset 

Free software only 


updates. 
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etating Ubu 
party sontware for graphics and WHF hardware, Flash, MP3 and other media 


arma ced th 2 acento Same a pveratary 
Layer} ae cing Lahey keresed ra tar 08 


Figure 4: The installer provides options, for MP3 support and downloading 


Harb Drives IN UBUNTU 


Ubuntu names device files on hard 
drives according to a particular 
schema: /dev/sda is the first detected 
hard drive, with /dev/sda7 its primary 
partition (/dev/sda2 through /dev/sda4 
are the three other primary parti- 
tions). The /dev/sda5 device is the first 
logical partition located in the (/dev/ 
sda2 extended partition. Windows 
should always be located in the first 
primary partition (/dev/sda1), and 
generally also in /dev/sdaz2. If you 
plug a USB stick or external hard 
drive in the USB slot, these external 
storage devices are listed as /dev/sdb, 
with everything else following the 
same schema. Using the sudo fdisk -I 
command, you can get an overview 
of the available hard disk and USB 
memory, as well as the available par- 
titions and filesystems. 


ports your hardware (printers, scan- 
ners, wireless, and graphics cards). 
Ubuntu 16.10 loads only the 3D ver- 
sion of the Unity desktop and uses LL- 
VMpipe for slower machines, creating 
sluggish responses on some older com- 
puters (cause for a recommended 
desktop replacement). 


The Ubuntu installer opens in a win- 
dow, as shown in Figure 4. First, 
choose a language. The next window 
checks whether your computer meets 
the installation requirements. The 
computer must have at least 5.9GB 
available drive space, plugged in (im- 


IssUE32 85 


WINDOWS AND UBUNTU 


Windows likes to save its files across the entire hard disk. By defragging the Win- 
dows partition, you arrange the scattered file fragments in a contiguous region. You 
can then shrink the partition without destroying any installed programs. In Win- 
dows 7, you can start the defragging with Start | Programs | Accessories | System 
Tools. In Windows 8, use the search option to look for the defrag program. If you 
freshly installed Windows, a program called chkdisk routinely looks for damage to 
the partition, and then Windows can boot normally. 


After defragging, you can begin shrinking the Windows partition, At the bottom of 
the Start menu, type hard and click Create and format hard drive partition. Window 
XP and Vista have similar functions. 


Next, select the Windows partition you want to shrink. Right-click and choose 
Shrink Volume, enter a desired value in the Total size after shrink in MB field, click 
Shrink, and restart Windows. 


In any case, after you install Ubuntu and restart Windows, Windows resorts to chk- 
disk to check for possible damage. The system then restarts the computer again be- 
fore starting up normally. Wubi [2], the tool to install Ubuntu on Windows, is in- 
cluded with Ubuntu 16.10, and you will be able to use it up to Windows 7. Wubi 
only works with Windows 8 and 10 if the machine uses the old BIOS firmware and 
the hybrid sleep option is disabled. 


Installing Windows after Ubuntu is so complicated that we don’t recommend you 
do it. But, if you do plan to do so, choose to create a manual partition in the 
Ubuntu installer (as described in the “DIY Ubuntu” box) while reserving an empty 
/dev/sda1 partition for Windows. 


portant for laptop and netbook instal- 
lations), and, preferably, be connected 
to the Internet. 

In this window, you can set two 
checkmarks. If you mark Download 


will allow you to play MP3 files on 
your player and see flash content in 
your browser. These two options can 
always be set later, so, for now, Next 
takes you to the next window. 


updates while installing, Ubuntu uses 
the idle time during installation to 
download patches and security up- 
dates from the Internet but doesn’t in- 
stall them yet. 

Marking Install this third-party soft- 
ware loads causes Ubuntu to load a 
few important codecs and plugins for 
your system. These codecs and plugins 


‘currently bas Ubuntu 160675 on lt what would you Uke to da? 


3604175 to Ubuntu e 10 


Something else 


Figure 5: Choose to erase the entire disk for the Ubuntu install or make a dif- 


ferent selection. 
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If a wired network connection exists to 
the network and Ubuntu recognizes your 
wireless card, the next window displays 
the discovered access points. Using the 
correct password, you can connect to the 
access point. If no choices are available, 
you may have a problem with your wire- 
less hardware. For now, use a wired con- 
nection instead. 


Back stall Now 


place. 


Choices, CHOICES 

A new window then appears that was 
introduced in Ubuntu 12.10. If Ubuntu 
doesn’t find another operating system 
installed, it provides the options, as be- 
fore, to Erase disk and install Ubuntu or 
to do Something else (Figure 5). 

Version 12.10, added two additional 
options: Encrypt the new Ubuntu instal- 
lation for security and Use LVM with the 
new Ubuntu installation. If you encrypt 
Ubuntu, the performance is a bit less 
than optimal, although encryption se- 
cures data against theft. Note that you 
can always encrypt your home directory 
later. 

If you have another resident operating 
system, such as Windows 8, the option 
Install Ubuntu alongside Windows 8 ap- 
pears on the screen, which you can in- 
voke using Continue. In this case, the 
options for encryption and LVM are 
grayed out and not available. If you have 
an older Ubuntu version, additional op- 
tions appear in the installer window. 


UBUNTU FLYING SoLo 

Installing Ubuntu by itself takes up the 
entire hard disk and writes all files into 
the /dev/sda1 primary partition. Also, the 
Ubuntu install creates the break /dev/sda2 
extended partition and, within it, the /dev/ 
sda logical partition that houses the swap 
area (see the “Hard Drives in Ubuntu” 
box). The swap area includes the swap file 
that takes over when working memory is 
overloaded, although writing to the swap 
area is noticeably slower than direct access 
to main memory. 


Usuntu NEIGHBORS 
Windows often takes up the entire 
hard drive. If you want to install 


The nstalation maytake mech longer. 


Figure 6: If you use the complete encryption that Ubuntu provides as an 
option, be sure to use a secure password (security key) and keep it in a safe 
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Ubuntu alongside Windows, you must 
shrink the Windows partition and 
completely defrag it, as described in 
the “Windows and Ubuntu” box. 
Ubuntu 16.10 then invokes the GRUB 2 
bootloader, which boots both systems 
and can handle new computers sup- 
porting Secure Boot. 


INSTALL Now 

If you opted for self-partitioning, click 
Install Now. To set up complete en- 
cryption, Ubuntu asks for a security 
key. Select the most secure one possi- 
ble (Figure 6). Ubuntu then asks about 
your location (Where are you?, to get 
the time zone), Keyboard layout, 
name, username, and password (Who 
are you?). The latter dialog also asks 


REVIVAL 


whether you want to Require my pass- 
word to log in or Log in automatically, 
with an additional option to Encrypt 
my home folder. Ubuntu uses EcryptFS 
for encryption. 

The following screens are for select- 
ing your timezone, selecting your key- 
board, and setting your username and 
password. If you have one of the sup- 
ported Ubuntu webcams, the installer 
also suggests that you take an image of 
yourself to complement your profile. 
Ubuntu 16.10 can also import profiles 
from other installed operating systems, 
including not only browser and email 
files, but also screen backgrounds and 
documents. 

During the install process, you can 
view a slideshow that presents the 

new features in 
Ubuntu. Installa- 


To revive an installed Ubuntu, boot up Live mode on the DVD 
in this issue by choosing the Try Ubuntu without installing 
option. Be sure that the Live and installed versions are the 
same architecture. Then, invoke a terminal and execute the 
following commands. Substitute for /dev/sda6 entry the spe- 
cific partition in which the root directory (/ of the installed 


Ubuntu is located. 


sudo mount /dev/sda6 /mnt 

sudo mount -o bind /dev /mnt/dev 
sudo mount -o bind /sys /mnt/sys 
sudo mount -t proc /proc /mnt/proc 
sudo chroot /mnt 

grub-mkconfig -o /boot/grub/grub.cfg 
update-grub2 

grub-instal] /dev/sda 

exit 


sudo reboot 


Use the chroot command (change root) to mount the in- 
stalled system into your Live system and work with it as if 
you had booted it. Now you can set up a new GRUB2. 


DIY UBUNTU 


tion can take a 
while, depending 
on your system, 
and it ends with a 
prompt to Restart 
Now. Remove the 
CD/DVD and 
press Enter so 
that the computer 
reboots. If you ac- 
tivated system en- 
cryption, enter 
the password be- 
fore booting up. 


UPDATING UBUNTU 
If you have 
Ubuntu 14.04 in- 
stalled, you may 
want to upgrade 
to 16.04 instead 
of 16.10. Both are 
Long Term Sup- 


If you want to maintain some control over the installa- 
tion, select the Something else option, although this op- 
tion requires some knowledge of the Ubuntu hard drive 
structure (see the “Hard Drives in Ubuntu” box). Ideally, 
you would place at least two logical partitions for 
Ubuntu on an empty hard drive: a swap partition (/dev/ 
sda5) and a partition for the root directory that is at least 


4.9GB (/dev/sda6). 


Optionally, add an extra partition for the /home directory 
(/dev/sda7) that gives you enough space for all your files. 
This partitioning has the advantage that you can install 
Ubuntu again later without losing your user data. Add 
the new partitions using Add. For the /and /home direc- 
tories, selecting the Ext4 filesystem is best. 
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port (LTS) versions, so 14.04 will be 
supported until 2019 and 16.04 until 
2021. If you have an earlier version of 
Ubuntu, you will have to upgrade to 
the intermediate versions first. Before 
beginning, turning off the external re- 
positories and PPAs makes sense. On 
earlier versions, prior to 16.10, use the 
Software Center Edit | Software Sources 
function and remove the check marks 
on the Other Software tab. 

Next press Alt+F2 and enter up- 
date-manager -d. In the empty window 
of the update manager, an Upgrade 
button shows at the top. During the 
upgrade, the installer asks whether 
you want to keep or replace a specific 
configuration file; choose to replace if 
you haven’t made any changes. Be- 
cause Ubuntu is downloading many 
packages and replacing them, make 
sure your computer is plugged in to 
stay charged. 


BOOTLOADER FAILURES 

Occasionally, the bootloader doesn’t 
appear after an Ubuntu installation, or 
sometimes you can boot only one sys- 
tem. Loading Windows after installing 
Ubuntu often leads to a bootloader 
failure. Refer to the “Revival” box for 
commands you will want to enter in a 
terminal window. These commands in- 
stall the GRUB2 bootloader with help 
from a Live system so that GRUB cor- 
rectly identifies all systems. e 


INFO 
[1] Download Ubuntu 16.10: Attp:// 
releases.ubuntu.com/yakkety/ 


[2] WubiGuide: https:/wiki.ubuntu. 
com/WubiGuide 


Figure 7: Installation can take a while, but it is painless and can generally be 
left to its own devices. 
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With NetworkManager, you can access 
the Internet during the Ubuntu 
installation process. The first step is to 
download updates to make your system 
more secure. 


Installing updates. 


come 
Downloading (boridegteore® 
» Detalls 


Figure 1: If Ubuntu updates are out there, you'll 
find out by invoking the "Software Updater” pro- 
gram. 


Updated software has been issued since 
B Ubuntu 16.10 was released. Do you want to 
Install it now? 


7 Details of updates 


Download 


mava 
Web browser engine for Qt (codecs) ssia 
browser engine for Qt (core libr... nama 

© E web browser engine for Qt (OML plu. 140k 

© E web browser engine for Qt (QtQuick cory 
© other updates nse 
» B A archie Manager sa 


» Technical description 


(BG seme witrecowntonses 


Settings. Remind Me Later || InstallNow 


Figure 2: Ubuntu shows details on what updates 
are waiting in the queue. 
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NetworkManager and system updates 


ACTIVE TRAFFIC 


BY KRISTIAN KISSLING, PAUL BROWN 


fter the official release of a distri- 

bution, the developers continue 

to iron out bugs with various 

patches, and they continue to 
minimize security vulnerabilities during 
the entire support period of the operating 
system. Ubuntu 16.10, for example, will 
be supported for the next 9 months. If you 
install the distribution a few weeks after 
its official release, updates are already 
available. 

To look for updates, call up the Software 
Updater program (Figure 1), which dis- 
plays a list of installable patches. Clicking 
Install Now downloads the patches onto 
your computer (Figure 2). Restart the sys- 
tem to apply the patches. If no updates are 
available, you will see The software on this 
computer is up to date (Figure 3). 

Bug fixes help keep your system safe 
and secure. With a few exceptions, such 
as Firefox and Thunderbird, newer ver- 
sions of installed programs are updated 
with the next Ubuntu version. Within the 
support cycle of Ubuntu 16.10, only Back- 
ports and PPAs [1] can be applied to a 
new version. Backports are special reposi- 
tories that provide newer versions of some 
software [2]. 


CHICKEN AND EGG 
To get updates for Ubuntu 16.10, you must 
have access to the Internet. The Network- 
Manager helps you set up that access dur- 
ing the installation. If you’re not cabled 
in, the installer presents a window listing 
the neighboring wireless networks and 
asks you to connect to one, which is when 
installation begins in earnest. 

To bypass this step, install Ubuntu with- 
out Internet access, and then later set it up 


ð The software on this computer Is up to date, 


Settings... oK 


Figure 3: No updates are needed and you are 
good to go. 


through the NetworkManager, which is 
represented by a small icon at the top right 
of the screen. If you’re using a wireless 
card, you will see a wave-shaped icon and, 
if the system is connected, the icon reflects 
the quality of the connection. Since 
Ubuntu 12.10, connecting to the Internet 
even before signing onto the desktop is 
possible. 


WIRELESS PROBLEMS 

Not all wireless cards work flawlessly with 
Ubuntu. Before you install Ubuntu on your 
computer, use the Live version to test 
whether Ubuntu recognizes your wireless 
chip. Boot into Live mode and try to con- 
nect to one of the wireless networks dis- 
played. If connecting fails or no access 
points are showing, check the hardware 
switch on the computer itself. 

If you run into problems configuring 
wireless cards, DSL modems, or UMTS 
sticks because NetworkManager doesn’t 
recognize them, temporarily connecting 
the computer with a network cable to a 
switch or router usually works. 

Hardware is a frequent source of wire- 
less problems. On many notebooks, a but- 
ton turns on the wireless card, whereas on 
others, a special key combination (e.g., 
Fn+F5) or a single F keystroke works. Test 
to see whether the WLAN has been deacti- 
vated by mistake. 

To enable access for DSL, UMTS, and so 
on, click in the upper right on the Net- 
workManager icon and choose Edit connec- 
tions. Through Connection information, 
you can find out whether the access point 
provided you an address via DHCP (Figure 
4). DHCP (Dynamic Host Configuration 
Protocol) is the service that automatically 
assigns you an IP address in the local net. 
Most routers provide DHCP addresses by 
default. 


ETHERNET 

Wireless routers usually have inputs for 
network cables. If the router assigns IP ad- 
dresses with DHCP, which it usually does, 
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Connection Information 


Active Network Connections 
Wired connection 1 (default) Flippynet 


General 

InterFace: 802.11 WiFi (wip 12s0)| 
Hardware Address: 00:1F:3C:B1:9B:FC 
Driver: iwl3945 

Speed: 54Mb/s 

Security: WPA/WPA2 

IPv4 

IP Address: 192.168.1.114 
Broadcast Address: 192.168.1.255 
Subnet Mask: 255.255.255.0 
Default Route: 192.168.1.1 

Primary DNS: 192.168.1.1 

IPv6 

IP Address: Fe80::c2c8:Fb16:64aF;9807/64 


Close 


Figure 4: Connection Information provides some 
helpful connectivity facts. 


NetworkManager automatically connects 
after you plug in the network cable. Rarely 
does this not work, but if that is the case, 
you must assign an IP address and domain 
name manually. 


WIRELESS NETWORKS 

So that Ubuntu can set up your wireless 
card properly, the kernel needs to find a 
suitable driver for the card. Then, it’s as 
easy as clicking the NetworkManager to 
obtain the neighboring networks (Figure 
5). Select the name of the wireless net- 
work and log in with your passcode. 

To avoid mistyping the password, make 
the password visible. Ubuntu automati- 
cally detects the encryption type (WEP or 
WPA) the access point uses. After a suc- 
cessful network authentication, your wire- 
less card provides you with a valid IP ad- 
dress via DHCP. 

Setting up your smartphone (Android or 
iPhone) as an access point, which is called 
tethering, also works. NetworkManager 
treats the tethered smartphone as a normal 
access point and connects to it. Smart- 
phones use the Universal Mobile Telecom- 
munications System (UMTS) to get to the 
Internet, which is a good solution when 
you are on the move. Don’t forget, how- 
ever, to secure the access point on your 
mobile phone with a good password and 
deactivate it when you are done. 

If the kernel doesn’t provide a driver for 
your wireless card, a proprietary driver is 
usually available. To test this, press the 
Windows key and open the Software Repos- 
itories program. If the Additional Drivers 
tab lists the driver for your card, click Acti- 
vate so that the wizard can download the 
corresponding software for the card. 


Wired connection 1 


onnect 


Flippynet 


ct to Hidden Wi-Fi Netw 


Enablet 
Enable Wi-Fi 
Conn 


Edit Connect 


Figure 5: NetworkManager displays the neigh- 
boring access points, which is generally the first 
choice when accessing the Internet. 


If both steps don’t work, search online 
for Ubuntu 16.10 {YOUR WIRELESS CHIP}. 
To find out what your built-in wireless chip 
is called, press Ctrl+Alt+T to open a termi- 
nal and enter: 


$ lspci | grep "Network" 


For a USB device, use the following com- 
mand to find the chip's ID number: 


$ lsusb 


An Ubuntu help page [3] lists the wireless 
card and its degree of support in Ubuntu 
and its derivatives. Setting up an unsup- 
ported wireless cards can be complicated 
on occasion, and other times a simple shell 
command can activate a card. In some situ- 
ations, programs such as Ndiswrapper 
allow use of the card’s Windows driver 
with Ubuntu [4]. 


UMTS Caros AND DSL Mopems 


Using NetworkManager, you can also set 
up UMTS cards and chips, as well as DSL 
modems. Of course, the system must recog- 
nize the hardware; otherwise, the tabs are 
grayed out. Once Ubuntu identifies a UMTS 
card, insert the card into the USB slot, 
enter the PIN, and configure it using Net- 
workManager. 

DSL modems are also candidates for 
NetworkManager. Click Edit Connections 
and choose Add on the DSL tab, connect 
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the DSL modem to the phone jack and 
your computer via cable to the modem, 
and apply the access credentials from your 
Internet service provider. These credentials 
will go on the DSL dialog. 

Usually you will find a long line of text 
among the data, including the @ character. 
The part before the @ is your username, 
and the part after it is the service name. 
Then, enter the passcode and change to 
the Wired tab, where you enter the MAC 
address of the network card connected to 
your DSL modem. The name is usually 
ethO. After you determine the address, 
open a terminal and enter: 


$ /sbin/ifconfig'| grep Hardware 


The MAC address consists of six two-char- 
acter sections separated by colons. Enter 
the MAC address in the field for the DSL 
configuration. 


VPN Connections 

If you want to surf securely on the Internet 
through a tunnel, use a virtual private net- 
work (VPN) solution such as OpenVPN, 
which NetworkManager also supports. De- 
tails on OpenVPN and how it works with 
Ubuntu are in an article in Ubuntu User 
Issue 13, page 58-59. 


TROUBLESHOOTING 

If the DSL or UMTS modem is still giving 
you problems despite the correct driver, 
NetworkManager may have a bug. One so- 
lution is to install a recent version of the 
software by integrating a PPA. This pack- 
age often provides a newer version than 
the one normally used by Ubuntu. Often 
you can solve network problems by im- 
porting all updates for your release and re- 
starting the computer. e 


INFO 


1] Packaging/PPA: https:/help. 
launchpad.net/Packaging/PPA 

2] UbuntuBackports: https:/help. 
ubuntu.com/community/ 
UbuntuBackports 

3] WifiDocs/WirelessCardsSup- 
ported: https:/help.ubuntu.com/ 
community/WifiDocs/ 
WirelessCardsSupported 

4] WifiDocs/Driver/Ndiswrapper: 
https:/help.ubuntu.com/ 
community/WifiDocs/Driver/ 
Ndiswrapper 

[5] Using OpenVPN Under Ubuntu: 

http:/www.ubuntu-user.com/ 

Magazine/Archive/2012/13/ 

Using-OpenVPN-Under-Ubuntu 
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The new Ubuntu Software app lets you 
install just about anything, including 
free software, purchased apps, and 
games, 


Software management in Ubuntu 16.10 


TODAY'S 


SPECIALS 


BY KRISTIAN KISSLING, PAUL BROWN 


buntu 16.10 comes with some 

changes to the way you install and 

manage extra software on your com- 

puter. Ubuntu’s tailor-made Software 
Center is gone, replaced by the lighter (and 
prettier) Gnome Software app (dubbed simply 
Ubuntu Software). You'll find some changes 
on the command line, too. 

The new Software app provides centralized 
software management and allows you to 
search for new software and install it with a 
mouse click. With an Ubuntu One account, 
you can purchase software with a credit card. 

The Debian packages (ending in .deb) that 
the Software app offers are actually archive 
files containing libraries, configuration files, 
and executable programs. If you install the 
Firefox package, for example, the package 
manager distributes the necessary files to the 
correct places in the filesystem for you. 

Packages often have dependencies, which 
means installing program A requires that you 
have program B also installed. The package 
manager identifies the dependent packages 
automatically during installation and loads 
them onto your computer. Usually, you will 
notice the dependencies when you try to in- 
stall a single Debian package over the Internet. 

The package you are looking for, such as a 
video codec, may be missing in the Software 
app. In this case, you can find the package in 
external repositories 


k 
na 
5) 
© 
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created by the software’s users or develop- 
ers. The repositories contain not only the 
software but also the packages on which 
they depend. (How to tap into these reposi- 
tories is covered in the “What Are Reposito- 
ries?” section.) 


PACKAGE MANAGER IN ACTION 

Getting to repositories and installing software 
is often faster from the command line. The 
“Quick Sources” section goes into greater de- 
tail. First, let’s look at managing packages 
using Ubuntu’s Software app. To access the 
Software app, press the Super key [1] and 
enter softw. The start page features the Edi- 
tor’s pick and Recommended games applica- 
tions, as well as a Featured Application at the 
top (Figure 1). 

If you scroll down, you'll see several cate- 
gory buttons. Click on any of the buttons, and 
you'll see a list of subcategories listed down 
the left-hand side of the window. Click on In- 
ternet, for example, and the list will show Fea- 
tured, All, Action, Adventure, Arcade, etc. 
Click on any subcategory, and you can browse 
for individual apps (Figure 2). Use the arrow 
icon in the upper left to return to the start win- 
dow. 

You'll find three other controls at the top of 
the package management window. The All 
tab lists all the software in all the available re- 


Figure 2: Clicking a subcategory on the left shows individual apps you can install. 
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Figure 1: The Software app encourages you to browse. 
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Figure 3: Check for new versions of your software in the Updates tab. 


positories. This is the default view. 

The Installed tab displays only the installed 
applications, sorted by category. You can use 
this view to remove software you don’t want 
or need anymore. Downgrading, unfortu- 
nately, doesn’t work in the Software app. To 
do that you must install the Synaptic Package 
Manager and specify an earlier Version in the 
Properties. 

Updates shows new versions of installed 
programs that you will want to install to get 
rid of bugs and open vulnerabilities (Figure 3). 
Most updates will install automatically by de- 
fault, so this tab will usually be empty. You 
can disable this behavior in the settings. 

If you already know the name of the soft- 
ware, choose the All tab and use the search 
field at the top center of the view. Results 
show up as you type, and next to the software 
names are the ratings in the form of stars. You 
can install directly from the list or click on the 
programs icon and read more about the app. 

The app’s information screen will include a 
screenshot, a description, and comments from 
users, as well as information about the ver- 
sion, the license it is distributed under, and 
how much hard disk it will take up once in- 
stalled (Figure 4). Finally, click the Install but- 
ton to install the program. Once the program 
is installed, you can click the Write a review 
ink to evaluate the software. This requires an 
Ubuntu One Single Sign-on account [2]. 

The search won’t find all programs. The 
Software app does not list libraries or devel- 
oper files. To install these packages, you will 
have to use the apt command-line utility. 

To add other repositories, click on the 
Ubuntu Software drop-down menu at the top 
of the screen and choose Software and Up- 
dates (Figure 5). More on this later. 


Whar Are REPOSITORIES? 

The Software app gives you access to thou- 
sands of packages, but the one you want 
might be missing or only in an older version. 
This is where external repositories and the 
PPAs help. 


igure 4: Once you choose an installable package, you'll get further informa- 


tion on it: ratings, screenshots, descriptive text, and more. 


The Opera reposi- 
tory [3] is one such external repository, and it 
provides the Opera web browser that is miss- 
ing from Ubuntu’s standard repositories. The 
VirtualBox project [4] also provides the pro- 
prietary version of its own software, which 
supports the virtual USB 2.0 ports and Re- 
mote Desktop Protocol (RDP), from its own 
repository. 

Personal Package Archives (PPAs) are spe- 
cial versions of external repositories that you 
can only find on Ubuntu’s Launchpad. When 
experienced Ubuntu users or developers cre- 
ate Debian packages out of their favorite soft- 
ware, they frequently offer them in their per- 
sonal package archive on Launchpad. Using a 
search function [5], you can peruse the plat- 
form for new versions of current software 
with great success. 


COMPLEMENTING PACKAGE SOURCES 
As explained above, in the Software app, you 
can download from external repositories 
using Ubuntu Software | Software and Up- 
dates. To use the Opera project’s external 
sources, for example, click Other Software and 
Add, then enter deb http://deb.opera.com/ 
opera/stable non-free. This address wasn’t in- 
vented: Usually, the address is the website for 
the external repository. Click the Add Source 
button to accept the repository (Figure 6). 
External reposito- 
ries often protect 
themselves from 
abuse with keys. 
Every package has a 
signature verified 
with a key, so that 
manipulated pack- 
ages with mis- 
matched signatures 
fall by the wayside. 
Often, you can’t ac- 
cess a package offer- 
ing without a key, but 
how do you find the 


Featured Application 


To import the key for the Opera repository, 
invoke a terminal through Ctrl + Alt + T and 
use the following command: 


$ sudo apt update 


The command updates the list of available 
software for the Software app and returns an 
error message. Then, enter: 


$ sudo wget -0 - 2 
http://deb, opera.com/archive.key 2 
| sudo apt-key add - 


For other repositories more tied in with 
Ubuntu, you may have to query the Ubuntu 


keyserver: 


$ sudo apt-key adv 2 


--recv=keys --keyserver 2 
hkp://keyserver.ubuntu.com:80 2 
B9A06DE3 


In this case, the preceding command downloads 
the appropriate key (B9A06DE3) for the devel- 
oper’s Launchpad PPA for the Inkscape vector 
design software and integrates it with package 
management. If you can’t get to the keyserver, it 
may be temporarily overloaded. Replace key- 
server. ubuntu.com in the command with another 
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Figure 5: Choose or add new repositories to access more software. 
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Figure 6: Obtain additional packages from exter- 
nal repositories. 


keyserver, such as subkeys.pgp.net, pgp.mit.edu, or 
keys.gnupg.net. After the sudo apt update com- 
mand, you should be able to install the software 
from the source. The new repository might not 
show up in the Software app right away. 


Key OVER TERMINAL 

As seen above, most websites show a simple 
line that you can copy with Ctrl + C and Ctrl + V 
to the terminal. The line might appear as in the 
following VirtualBox example: 


$ wget -q 2 
http://download.virtualbox.org/2 
virtualbox/debian/oracle_vbox.asc 2 
-0 - | sudo apt-key add - 


The command downloads the key from the 
website (using wget -q {HTTP-LINK}), sends it 
to the console (with -O -), and passes it to the 
sudo apt-key add command. Then, use sudo 
apt-get update to update the package list and 
load up the VirtualBox package. 


INTEGRATING PPAS 
With about 6,000 active PPAs on Launchpad, 
it is easy to get brand-new software versions 
with the latest functionality. Among them are 
exotic programs and (unstable) developer ver- 
sions of system components such as the ker- 
nel or NetworkManager. Before compiling 
software from the sources, first use a PPA 
search [4] to see whether a PPA might exist. 
The fastest way to integrate PPAs into the 
package manager is through the command inter- 
face because it saves you the key search. Press 
Ctrl + Alt +T to open the terminal and enter 
what usually amounts to three command lines, 
something like the following: 


$ sudo add-apt-repository 2 
ppa:inkscape.dev/stable 

$ sudo apt update 

$ sudo apt install inkscape 


These commands mount the PPA for the Inkscape 
vector drawing solution. For other software, simply 
replace the parts after ppa: and sudo apt-get install. 
Take the text for the part after ppa: from the website 
(Figure 7). It may take a while for the repository to 
appear in the Software app. 
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sudo add-apt-repository ppa:inkscape.dev/trunk 
sudo apt-get update 


D Technical detats about this PPA 


For questens and bugs with softwa e inthis PPA please contact g8 iniscape Developers 


Overview of published packages 


Poblished ve vaiet 


(Ea arona cro ecm Taunchpadinet o cle JyBt Roe 
Cosi Ronin 
2 “Inkscape Developers” team 
Code Bugs Blueprints Translations Answers 
Inkscape Trunk O Vw stage tas 
Latest updates 
bisage iron y 
screstay bat 
capetrak rono 
Seenaa bot 
bbscapetnak rrara 
Saccone bo 
bisage vesise 
scent bot 
Adding this PPA to your system PPA statistics keds 
‘You can update your system with unsupported packages from this untrusted PPA by adding Activity ‘Success lly bul Y 


75 updates added during the past moneh. 


Figure 7: In this PPA, you'll find the current packages for Xenial Xerus to install the Inkscape design application. 


REMOVING SOFTWARE 

To remove software, open the Software app, 
search for the name of the software, and click Re- 
move. The configuration data is unaffected. The 
advantage is that you don’t need to reconfigure 
the software if you decide you need it again later. 
If these remnants (such as you might find in the 
/etc or /var directories) were to disappear, use 
the command line to remove the package. 


Quick Sources 

The Software app is a graphical interface for APT, 
the Advanced Packaging Tool, which manages the 
list of software in the repositories in the background. 
As already noted, you can also run apt over the 
command line; many experienced Ubuntu users 
prefer this method because the commands work 
with any Ubuntu derivative. Following are four im- 
portant commands: 


$ sudo apt update 
$ sudo apt search 2 
(--names-only) inkscape 
$ sudo apt install inkscape 
$ sudo apt remove (--purge) inkscape 


The first command brings the package list up to 


date. It is important to keep all the software on 
your system current considering how quickly 


INFO 


program versions change. The next line searches 
for a package with a name or description that in- 
cludes the term inkscape. Add the -names-only 
option (without the parentheses) to the com- 
mand to search for the package name only. The 
third line installs the package, and the fourth line 
removes it. Use the -purge option to purge the 
configuration files in the home directory along 
with the package. 

‘To remove all the packages installed through a 
PPA, either use the Software app and choose the 
PPA next to Installed. Another way to remove a 
package is to stay on the command line, install 
the ppa-purge package, and enter the following 
command: 


$ sudo ppa-purge ppa:inkscape/stable 
for the Inkscape example. 


SINGLE CONSIGNMENTS 

Finally, there are some websites that provide sin- 
gle Debian packages to download. To install the 
software, double-click the DEB package. Ubuntu 
then calls the Software app and recommends in- 
stalling the package. Once you click OK, the 
package appears together with a screenshot and 
description in the Software app. Finally, down- 
load the package with Install. e 


[1] Meta, super, and hyper keys: http:/askubuntu.com/questions/19558/ 
what-are-the-meta-super-and-hyper-keys 
[2] Ubuntu One Single Sign-On: https:/login.ubuntu.com/ 


[3] Opera repository: http:/deb.opera.com/ 


[4] VirtualBox project: http:/Avww. virtualbox.org/wiki/Linux_Downloads 


[5] PPAs in Launchpad: https:/launchpad.net/ubuntu/+ppas 
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You can watch movies, play music and 
place calls over the Internet with ease 
with Ubuntu. You just have to load the 
right software packages onto your 
computer. We present some of our 
favorite multimedia apps. 


Multimedia components and proprietary programs 


THATS 


ENTERTAINMENT 


BY TIM SCHURMANN, MARCEL HILZINGER, PAUL BROWN 


laying movies and music, ripping 

DVDs, and making Skype calls - 

that’s all possible with Ubuntu. 

Although the Ubuntu installer al- 
ready provides basic “third-party” multi- 
media codecs, these options might not 
fulfill everyone's wishes. At least, the dis- 
tribution loads the legitimate MP3 codec 
from Fluendo onto the computer through 
the ubuntu-restricted-addons package, 
along with components for the GStreamer 
framework (plugins-ugly, plugins-bad, 
ffmpeg) and a Flash plugin installer from 
Adobe. 

As a result, you can play MP3 files, burn 
audio CDs, and view more than 90 movie 
formats right after installation. However, 
the installed package is not compliant with 
the wbuntu-restricted-extras package that 
you should install after the installation. It 
provides additional codecs for GStreamer, 


Ubrary 

D play queve 

Music 
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some typical Microsoft fonts (that you need 
to sign an EULA for first) and the UnRAR 
unpacker. You’ll also need to install the 
LAME library so that you can create and 
play MP3 files from audio CDs. 


GSTREAMER 

Generally, numerous programs in Ubuntu 
play music and movies, but there are some 
standard apps. Rhythmbox (Figure 1) is the 
preinstalled app for playing music. You can 
use the software to convert CDs to MP3 
format, although RipperX [1] is much bet- 
ter suited for this. Totem, on the other 
hand, is the default video player. This very 
simple player uses the GStreamer format. 
The drop-down menu used to access the 
videos and podcasts from YouTube and the 
BBC in the past is missing in the current 
version (Figure 2). Many users, however, 
also install VLC, the multimedia player that 
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Figure 1: Rhythmbox plays not only MP3s but also radio stations, and it provides integrated music 
shops. Better software exists for converting from audio CDs. 


WWW.UBUNTU-USER.COM + UBUNTU USER 


ISSUE32 93 


MULTIMEDIA APPS 


over your media, VLC is a better option. 


plays everything, provides more features 
than Totem, and can be extended easily 
through modules. You can find these mod- 
ules using the command-line apt tool if you 
search with; 


apt search vlc-plugin 


With CDs and DVDs fall from grace, there 
is no preinstalled default app for burning 
disks. You can still find Brasero in the 
Software app, however. Brasero provides 
an integrated cover editor. Although Bra- 
sero does not do Blu-ray recording. How- 
ever, K3B, also available in the Software 
app, does, although it will involve some 
system tweaking. Apart from K3B, you 
will have to install a special PPA that 
substitutes wodim, the default underly- 
ing disk-burning software, for cdrecord, a 
software that can handle Blu-ray disks. 
There are full instructions on how to do 
this online [2]. 

Running in the background for the pre- 
viously mentioned programs is 
GStreamer, which is a modular multime- 
dia framework that’s available to many 
audio and video apps. Thus, many pro- 
grams don’t need to support special co- 
decs because GStreamer provides the 
playback capability. To play an MP3 file, 
Rhythmbox hands over the task to 
GStreamer, which rummages through its 
resources for a plugin that takes care of 
the MP3 format. Using the contained co- 
decs, GStreamer converts the files into 
audible material (Figure 3). To teach 
Totem and Rhythmbox new data formats, 
often you can just install a matching 
GStreamer plugin. 
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Figure 2: Totem is becoming more and more minimalistic with every version. If you need more control 


DANGEROUS LIAISONS 

Although you can use these “limited ex- 
tras” for multimedia formats, you can’t 
watch encrypted DVDs - which covers 
just about all commercial DVDs. Well, you 
can but you have to bypass the Content 
Scrambling System (CSS). This requires 


libdvdcss2, provided by VideoLan [3], 
but this is considered a legal gray area 
in many countries. Use of this software 
is often banned because it cancels the 
CSS playback protection and is therefore 
considered to violate the “effective copy 
protection mechanism.” 

In some countries, you can resort to a 
commercial Linux program for legal play- 
back: the Fluendo DVD player [4], whose 
developers also participate in GStreamer. 
You can find the latter in the For Purchase 
repository. Until about a year and a half 
ago, you could turn to the Medibuntu re- 
pository. It used to house - apart from 
MPlayer and Mencoder - another codec 
package that you needed to play and edit 
movies in all formats. Medibuntu since 
has been closed and all of its packages 
have been moved to the main repositories 
(except for libdvdcss mentioned above). 


PARTNERS AND SHOPPING SOURCES 
Some proprietary applications like Skype 
and VMware View Client aren’t offered 
in the Ubuntu’s standard repositories. 
Although these programs might be free 
(as in beer), they're often under proprie- 
tary licenses and are not provided with 
open sources. 
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Figure 3: Rhythmbox and Totem rely on the GStreamer framework that provides the necessary plugins 
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Figure 4: You can download and play games with Valve's Steam as you would on other platforms. 
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These third-party apps can often be 
found in the Canonical Partners reposi- 
tory that you must first activate. In Soft- 
ware app, click on the Ubuntu Software 


drop-down menu and then on Software & 


Updates, click the Other Software tab, 
then activate the Canonical Partners 


entry. Again, it might take a while before 


the sources appear in Software Center. 
The For Purchase repository has com- 


pletely disappeared from Ubuntu 16.10. If 


you want to buy games, we recommend 
you install Valve’s Steam with 


sudo apt install steam 


Steam for Linux works exactly the same 
as for Windows (Figure 4). However, re- 
member that not all the games you can 
find for Windows work on Linux. Use 
Steam’s search functionality to find what 
you're looking for and, in the column on 


the right, under the Narrow by OS section, 


click the SteamOS + Linux (Figure 5) to 
limit the selection to programs that work 
on Ubuntu. 

GOG also provides games for Ubuntu 
now, and a command-line utility called 


Discover the past 
and invest in a new 
year of IT solutions 
at Linux New Media's 
online store. 
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Figure 5: Search for Steam0S+Linux to find games that will work on Ubuntu. 


lgogdownloader helps you manage down- 
loads, updates, and purchases from the 
site. 

That said, you can download some very 
cool free software games from the prein- 
stalled Software app. Click on the Games 
category, and you'll find a wide range of 
action, arcade, simulation, and puzzle 
games. Among our favorites, Minetest, a 
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fantastic open source mining, crafting, 
building, and survival game; OAD, a gor- 
geous-looking, civilization-building strat- 
egy game; PokerTH, which allows you to 
play the Texas hold ‘em variant of poker 
against computer rivals, on a local net- 
work or on public servers on the Internet; 
and finally, a front end for the MAME em- 
ulator, which will let you play thousands 
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Figure 6: Like Skype, Google Hangout provides video chat capability. 


of classical arcade and console games on 
your desktop. 


Apose Propucts 

Loading the flashplugin-installer package 
on the computer brings in the latest Flash 
versions direct from the Adobe website. 
You might have installed Adobe’s PDF 
Reader from the partner repository in the 
past. But, you will only need it if Ubuntu’s 
Evince built-in PDF viewer has break 
down opening a file - which does happen 
in rare cases with PDF files with 3D con- 
tent or very complicated graphics with 
many levels. For security reasons, you 
should avoid using Adobe Reader. 


SkYPE AND GOOGLE VIDEO 

Even the new version 4 of Skype is in the 
Canonical Partners repository. Apart from 
videotelephony, it also provides desktop 
sharing: To make collaboration easier, your 
conversational partner can peek at your 
desktop. Thanks to the new version, the 
image quality of Skype for Linux is gradu- 
ally matching that of the Windows client. 
Be aware, though, that Skype is one of the 
pieces of software that most spies on your 
communications. If you value your pri- 
vacy, don’t use it. 

As an alternative to Skype, check out 
Google’s Hangout video platform, which 
also allows calls among multiple partici- 
pants (Figure 6). You’ll need a Google ac- 
count, so register at the Google website 
and go to the left at the top of the 
Google + profile. In the right-hand col- 
umn, select Start Hangout and install a 
video plugin for your system. You can sim- 
ply download the corresponding DEB 
package and double-click the file manager. 

Google Hangouts are also suspect when 
it comes to user privacy. An experimental 
but very secure and private alternative is 
Tox [5] (Figure 7), a new, free, and open 
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protocol that implements peer-to-peer en- 
crypted live communication, including 
audio and video chats. Your best bet is to 
download the ÎŒTox client [6]; then, you 
just have to decompress it, and it is ready 
to use. 


GOOGLE EARTH 

Those who enjoy using Google Earth [7] 
can also install it in Ubuntu 16.10. Just 
download the corresponding Debian 
package for your architecture, and then 
go to Software Center and install the lsb- 
core package. Double-clicking the Google 
Earth package loads it on the computer, 
which can take a while mainly because 
the package grabs additional files from 
an online server. Be sure you have 
enough free space reserved. Then, you 
can start Google Earth by entering goog 
in the Dash. Be forewarned, however, 
Google Earth is no fun without proper 3D 
acceleration. 


THe New JAVA 

To use Java applications, you need a Java 
Runtime Environment (JRE). Ubuntu 
does not provide Oracle’s proprietary 
Java version anymore - only the free 
OpenJDK. Because some Java programs 
had problems in the past with OpenJDK, 
many users often resorted to the proprie- 
tary Java (sun-java). But, that’s missing 
now because Oracle put it under a non- 
free license. Because the proprietary Java 
is compatible with OpenJDK 8 - the offi- 
cial Java reference - most Java programs 
should be able to make do with the free 
Java. You can install the software from 
the openjdk-8-jdk and icedtea-8-plugin 
packages, and the older version from 
openjdk-7-jdk and icedtea-7-plugin via 
the following command: 


$ sudo update-alternatives --config java 


Figure 7: Tox is secure and keeps your conversations, even your video chats, private. 


This step activates one of the parallel in- 

stalled Java versions. If an app refuses to 

run, it’s best to submit a bug report at the 
Ubuntu wiki [8]. 


SEEK AND You SHALL FIND 

You can install many proprietary apps 
and multimedia codecs from the existing 
repositories. Numerous proprietary Win- 
dows programs also run in the Wine Win- 
dows-compatible environment [9]. Other 
than that, take a look in the Ubuntu pack- 
age manager, because almost any applica- 
tion has a free alternative. e 


INFO 


[1] Ripperx: 
http:/sourceforge.net/projects/ 
ripperx/ 

[2] Recording Blu-ray disks: https:// 
help.ubuntu.com/community/ 
CdDvad/Burning#Blu-Ray_Burning 

[3] libdvdcss at VideoLan: 
http:/www.videolan.org/ 
developers/libdvdcss.html 

[4] Commercial GStreamer plugins: 
http://www.fluendo.com 


[5] “Safe Communication with Tox” 
by Vineze-Aron Szabo, Ubuntu 
User, Issue 24, pg. 44: 
http://www.ubuntu-user.com/ 
Magazine/Archive/2015/24/ 
Safe-communication-with-Tox 

[6] ÎŒTox: 
https://wiki.tox.chat/clients/utox 

[7] Google Earth: http:/www.google. 
com/earth/index.htm! 

[8] Reporting bugs: 
https:/help.ubuntu.com/ 
community/ReportingBugs 

[9] Wine: http:/www.winehgq.org/ 
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